-- Logs begin at Wed 2022-11-02 02:54:16 UTC, end at Wed 2022-11-02 04:24:42 UTC. -- Nov 02 03:24:54.835700 dv-cinder-860209-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 03:24:54.844610 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 03:24:54 2022] *** Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: nodename: dv-cinder-860209-6-iscsi Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: machine: x86_64 Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: clock source: unix Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: pcre jit disabled Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: detected number of CPU cores: 4 Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: current working directory: / Nov 02 03:24:54.847127 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: detected binary path: /usr/bin/uwsgi-core Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: your processes number limit is 47680 Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: your memory page size is 4096 bytes Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: detected max file descriptor number: 2048 Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: lock engine: pthread robust mutexes Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: thunder lock: enabled Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 03:24:54.847943 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 03:24:54.886862 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: Python main interpreter initialized at 0x55954510d9c0 Nov 02 03:24:54.886862 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: python threads support enabled Nov 02 03:24:54.886862 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: your server socket listen backlog is limited to 100 connections Nov 02 03:24:54.886862 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: your mercy for graceful operations on workers is 90 seconds Nov 02 03:24:54.887174 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 03:24:54.887254 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: *** Operational MODE: preforking *** Nov 02 03:24:54.887510 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: *** uWSGI is running in multiple interpreter mode *** Nov 02 03:24:54.887510 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: spawned uWSGI master process (pid: 103774) Nov 02 03:24:54.887692 dv-cinder-860209-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 03:24:54.888912 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: spawned uWSGI worker 1 (pid: 103775, cores: 1) Nov 02 03:24:54.888912 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: spawned uWSGI worker 2 (pid: 103776, cores: 1) Nov 02 03:24:54.888912 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 03:24:55.541279 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 03:24:55.542911 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 03:24:56.609006 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:24:56.609006 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: from cryptography.utils import int_from_bytes Nov 02 03:24:56.609697 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:24:56.609697 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: from cryptography.utils import int_from_bytes Nov 02 03:24:56.610082 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:24:56.610082 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: from cryptography.utils import int_from_bytes Nov 02 03:24:56.610489 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:24:56.610489 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: from cryptography.utils import int_from_bytes Nov 02 03:24:59.085863 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:24:59.086425 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:24:59.086615 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:24:59.086975 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:24:59.087075 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:24:59.087420 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:24:59.087513 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:24:59.087602 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.087754 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:24:59.087905 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.088138 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:24:59.088244 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.088395 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:24:59.088562 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.088780 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.088886 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089105 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089200 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089445 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089531 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089751 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.089852 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090078 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090165 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090339 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090466 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090648 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090735 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.090967 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-6-iscsi {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091061 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091282 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091376 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091555 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091651 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091867 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.091972 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092202 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092286 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-6-iscsi {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092502 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092600 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092812 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.092896 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.093121 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.093208 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.093436 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.093651 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094041 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094154 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094225 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094372 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094476 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094672 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094871 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.094984 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095193 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095293 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095488 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095585 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095800 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.095925 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096159 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096276 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096473 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096585 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096781 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.096871 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097099 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097189 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-6-iscsi {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097405 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097523 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097737 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.097875 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098130 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098425 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-6-iscsi {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098520 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098735 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.098819 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099184 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099353 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099440 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099666 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099757 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.099986 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100086 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100311 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100404 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100625 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100722 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.100938 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101047 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101252 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101343 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101549 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101653 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101851 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.101952 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102154 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102265 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102491 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102592 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102767 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.102857 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103066 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103156 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103304 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103475 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103636 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103722 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.103906 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104022 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104263 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104365 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104508 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104610 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104797 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.104882 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105041 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105140 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105355 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105451 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105677 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105765 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.105961 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106046 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106210 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106295 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106525 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106628 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106841 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.106927 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107141 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107239 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107444 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107541 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107742 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.107833 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108065 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108174 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108371 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108465 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108676 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108762 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.108980 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109072 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109306 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109406 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109621 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109710 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.109933 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110018 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110241 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110333 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110562 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110650 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110860 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.110944 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.111174 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.111259 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.111478 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.111848 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112061 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112149 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112377 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112463 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112680 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112778 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.112978 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113066 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113280 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113368 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113592 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113687 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113905 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.113997 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114203 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114287 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114449 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114534 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114743 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.114836 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115042 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115127 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115353 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115442 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115652 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115754 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.115976 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116076 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116273 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116358 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116568 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116663 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116869 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.116954 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117168 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117253 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117467 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117561 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117763 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.117847 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118060 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118144 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118362 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118455 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118660 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118746 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.118961 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119047 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119259 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119346 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119556 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119641 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119855 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.119963 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120187 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120274 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120488 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120574 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120789 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.120884 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121088 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121175 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121387 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121474 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121698 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121793 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.121997 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122083 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122296 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122390 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122598 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122681 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.122901 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123017 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123197 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123297 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123500 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123592 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123800 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.123889 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.124123 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.124224 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.124427 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.124511 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.124720 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.125338 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.125557 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.125644 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.125867 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.125961 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126174 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126260 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126472 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126556 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126766 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.126860 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127062 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127149 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127357 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127444 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127654 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127749 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.127968 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128069 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128265 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128351 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128557 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128652 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128858 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.128942 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129158 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129243 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129459 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129582 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129759 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.129844 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130059 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130145 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130372 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130468 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130676 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.130760 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.130981 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.131067 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.131283 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.131370 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.131599 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:24:59.131685 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.131928 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132042 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132279 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132373 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132593 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132678 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.132966 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133078 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133207 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133294 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133525 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133611 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133833 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.133927 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134138 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134224 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134443 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134529 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134756 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.134850 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135064 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135149 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135374 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135487 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135681 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.135779 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.136012 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.136116 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.136331 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.136425 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.136914 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137029 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137111 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137191 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137269 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137347 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137552 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137652 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137857 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.137943 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138171 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138256 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138498 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138586 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138808 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.138892 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139114 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139199 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139462 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139596 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139708 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.139827 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.140034 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.140181 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.140343 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.140476 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141229 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141328 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141542 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141642 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141851 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.141937 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142165 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142253 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142476 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142573 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142793 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.142879 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143100 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143190 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143407 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143503 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143715 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.143802 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144047 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144138 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144354 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144453 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144665 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144762 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.144970 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145057 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145284 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145380 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145594 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145679 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145903 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.145991 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146221 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146309 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146525 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146613 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146831 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.146918 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147138 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147225 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147437 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147523 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147735 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.147820 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148059 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148149 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148365 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148451 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148663 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148750 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.148964 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149051 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149267 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149352 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149576 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149661 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149886 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.149980 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150187 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150271 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150491 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150592 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150797 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.150885 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151102 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151195 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151404 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151503 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151711 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.151797 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152042 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152131 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152344 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152440 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152646 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152733 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.152953 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153039 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153253 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153423 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153639 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153861 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.153946 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154163 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154258 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154466 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154550 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154769 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.154854 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155075 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155163 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155378 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155464 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155685 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.155771 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156016 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156132 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156354 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156440 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156662 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.156973 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157067 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157298 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157398 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157605 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157751 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157913 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.157999 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158231 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158317 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158545 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158645 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158845 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.158932 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159150 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159236 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159450 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159549 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159752 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.159838 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160078 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160169 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160387 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160476 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160687 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160780 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.160987 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161080 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161288 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161376 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161587 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161672 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161885 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.161972 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162187 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162273 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162493 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162579 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162792 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.162876 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163094 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163191 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163390 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163474 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163714 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.163808 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164041 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164131 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164352 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164440 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164658 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164752 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.164991 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165082 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165296 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165390 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165604 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165700 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.165913 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166051 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166224 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166311 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166532 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166627 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166838 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.166930 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167145 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167231 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167460 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167767 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.167853 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168100 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168188 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168409 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168495 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168726 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.168812 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169031 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169115 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169346 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169442 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169648 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169735 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.169959 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170045 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170271 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170364 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170593 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170682 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170899 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.170995 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.171215 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.171301 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.171523 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.171608 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.171870 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172005 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172200 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172287 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172507 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172595 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172814 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.172914 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173121 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173207 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173434 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173518 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173740 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.173836 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174050 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174134 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174352 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174443 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174667 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174763 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.174971 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175058 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175284 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175371 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175583 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175678 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.175892 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176009 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176227 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176313 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176549 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176644 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176851 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.176944 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177160 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177246 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177476 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177563 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177783 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.177907 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178088 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178175 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178393 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178480 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178692 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178778 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.178993 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179079 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179297 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179386 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179607 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179693 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.179911 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180056 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180238 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180324 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180538 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180624 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180845 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.180940 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181147 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181233 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181445 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181541 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181743 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.181907 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182050 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182136 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182356 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182442 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182659 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182753 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.182960 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183045 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183273 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183359 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183569 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183656 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183867 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.183972 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184206 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184293 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184512 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184600 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184810 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.184896 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185109 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185196 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185407 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185503 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185724 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.185815 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186026 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186119 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186326 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186411 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186627 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186711 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.186938 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.187033 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.187241 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.187832 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188101 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188194 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188410 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188511 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188715 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.188802 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189027 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189113 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189336 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189429 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189641 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189729 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.189946 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190253 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190346 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190562 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190699 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190867 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.190951 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191178 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191266 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191480 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191565 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191787 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.191874 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192117 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192206 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192420 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192507 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192727 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.192814 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193037 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193123 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193349 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193593 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193680 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.193921 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194015 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194232 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194319 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194546 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194790 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.194884 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195123 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195230 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195438 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195530 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195756 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.195848 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196127 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196240 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196430 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196524 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196737 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.196823 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197038 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197124 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197338 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197432 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197644 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197729 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.197945 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198040 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198244 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198331 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198542 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198629 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198848 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.198943 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199150 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199235 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199448 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199533 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199747 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.199841 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200082 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200172 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200384 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200470 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200681 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.200983 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201068 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201280 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201365 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201591 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201684 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201893 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.201978 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202191 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202278 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202491 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202578 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202788 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.202873 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.203703 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.204030 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.204358 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.204448 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.204678 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.204774 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205013 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205129 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205318 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205443 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205618 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205793 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.205938 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206104 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206245 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206442 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206529 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206773 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.206860 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207119 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207208 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207421 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207512 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207718 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.207805 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208050 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208153 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208359 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208445 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208661 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208746 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.208964 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209050 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209260 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209353 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209565 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209659 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209864 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.209951 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210172 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210259 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210477 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210576 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210775 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.210909 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211072 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211160 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211376 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211475 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211678 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211772 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.211996 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212088 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212308 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212405 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212607 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212702 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.212908 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213001 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213205 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213291 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213504 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213589 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213802 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.213889 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214103 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214189 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214404 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214491 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214702 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.214789 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215014 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215100 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215319 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215411 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215617 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215702 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.215916 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216025 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216246 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216333 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216547 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216650 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216849 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.216936 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217151 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217236 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217466 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217561 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217768 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.217852 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218063 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218159 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218366 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218461 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218691 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218779 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.218996 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219088 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219293 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219388 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219597 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219687 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.219895 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220015 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220217 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220306 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220514 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220600 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220813 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.220898 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221111 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221198 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221416 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221500 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221715 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.221800 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222013 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222107 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222313 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222398 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222607 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222693 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222907 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.222993 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223210 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223303 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223531 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223626 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223837 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.223992 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224168 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224256 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224474 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224578 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224779 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.224865 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225086 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225177 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225400 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225500 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225703 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.225790 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226018 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226105 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226326 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226421 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226633 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226719 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.226931 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227018 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227231 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227318 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227546 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227637 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227852 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.227939 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228193 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228282 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228505 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228590 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228819 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.228904 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229122 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229209 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229425 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229511 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229739 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.229835 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230046 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230135 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230350 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230652 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230738 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.230956 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231081 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231259 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231346 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231567 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231663 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.231873 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232014 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232203 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232291 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232508 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232605 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232807 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.232892 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233112 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233206 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233415 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233511 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233715 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.233801 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234022 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234106 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234346 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234443 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234646 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234733 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.234948 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235245 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235333 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235549 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235638 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235847 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.235934 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.236204 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.236305 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.236513 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.236895 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237070 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237157 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237380 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237467 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237685 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237772 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.237997 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238085 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238302 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238389 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238608 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238724 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.238910 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239318 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239405 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239625 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239711 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.239933 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240083 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240261 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240348 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240563 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240650 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240862 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.240961 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241164 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241255 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241479 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241585 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241777 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.241899 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242210 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242377 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242520 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242694 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242833 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.242992 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.243122 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.243305 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.243432 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.243713 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.243801 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244044 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244183 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244346 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244433 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244650 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244757 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.244972 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245068 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245273 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245360 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245591 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245678 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.245945 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246029 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246269 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246364 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246569 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246736 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.246880 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247011 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247184 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247278 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247500 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247596 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247816 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.247904 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248145 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248234 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248453 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248751 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.248848 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.249068 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.249155 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.249383 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.249479 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.249689 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.250274 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.250512 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.250599 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.250843 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.250937 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251156 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251288 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251462 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251552 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251782 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.251869 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252141 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252231 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252443 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252529 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252744 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.252840 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253048 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253141 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253346 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253469 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253648 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253779 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.253964 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254100 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254264 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254424 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254570 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254729 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.254875 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255033 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255177 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255342 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255475 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255643 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255773 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.255988 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256113 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256293 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256412 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256597 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256733 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.256908 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257218 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257354 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257526 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257693 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257829 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.257959 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258131 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258274 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258452 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258575 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258753 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.258874 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259072 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259159 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259383 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259476 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259704 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.259798 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260045 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260148 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260352 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260439 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260672 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.260980 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261067 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261283 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261416 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261586 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261682 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261893 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.261981 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262226 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262313 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262529 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262622 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262839 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.262924 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263159 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263254 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263458 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263553 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263757 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.263844 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264088 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264178 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264487 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264691 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264779 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.264989 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265084 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265292 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265386 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265643 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265724 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.265944 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266039 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266242 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266329 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266564 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266650 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266865 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.266963 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267169 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267263 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267474 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267560 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267771 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.267869 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268094 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268185 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268483 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268693 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.268787 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269013 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269106 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269317 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269406 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269623 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269710 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.269932 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270018 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270236 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270329 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270542 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270630 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270844 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.270931 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271151 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271245 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271459 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271547 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271766 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.271854 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272099 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272191 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272403 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272493 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272711 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.272798 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273021 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273116 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273331 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273426 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273644 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273845 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.273959 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274168 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274257 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274476 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274565 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274783 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.274876 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275090 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275180 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275399 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275706 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.275794 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276301 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276389 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276630 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276719 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.276939 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277033 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277250 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277336 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277561 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277656 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277875 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.277964 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278188 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278275 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278497 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278602 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278806 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.278900 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279116 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279202 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279423 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279522 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279749 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.279843 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280093 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280186 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280395 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280704 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.280791 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.281013 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.281691 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.281843 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.281932 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282151 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282238 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282459 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282546 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.282857 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283076 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283164 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283383 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283478 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283686 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.283774 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284019 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284108 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284330 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284429 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284640 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284791 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.284951 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285039 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285264 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285360 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285570 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285664 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285876 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.285962 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.286183 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.286271 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.286494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.286690 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.286806 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287003 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287129 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287329 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287459 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287648 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287778 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.287995 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288100 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288299 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288419 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288612 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288734 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.288932 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289233 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289323 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289532 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289619 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289835 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.289931 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290136 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290224 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290435 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290523 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290748 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.290848 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291050 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291138 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291348 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291436 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291660 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291799 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.291969 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292057 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292297 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292492 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292609 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292832 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.292919 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293145 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293234 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293464 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293561 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293783 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.293870 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294093 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294187 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294393 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294489 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294709 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.294915 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295002 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295257 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295344 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295572 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295667 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295880 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.295986 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.296204 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.296304 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.296503 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.296591 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.297365 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.297499 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.297674 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.297771 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.297973 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298061 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298277 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298365 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298576 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298672 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298895 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.298983 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299194 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299281 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299493 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299590 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299792 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.299884 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300120 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300211 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300420 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300510 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300718 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.300806 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301017 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301103 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301313 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301407 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301618 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301705 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.301916 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302003 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302217 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302303 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302513 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302597 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302817 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.302904 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303118 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303204 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303422 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303508 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303724 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.303818 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304063 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304172 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304362 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304449 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304660 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304820 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.304960 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305046 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305262 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305355 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305577 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305673 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305884 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.305971 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306188 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306275 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306509 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306605 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306814 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.306901 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.307116 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.307343 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.307439 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.307670 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.307757 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308009 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308101 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308340 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308440 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308654 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308746 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.308954 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309096 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309255 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309351 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309554 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309818 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.309905 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310156 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310243 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310459 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310547 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310763 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.310858 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311066 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311163 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311369 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311456 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311672 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.311994 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312101 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312322 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312415 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312629 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312716 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.312932 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313027 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313237 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313325 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313539 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313625 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313841 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.313965 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314143 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314232 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314452 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314540 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314759 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.314845 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315069 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315157 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315377 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315465 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315684 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.315771 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316009 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316100 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316316 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316402 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316621 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316710 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.316924 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317018 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317226 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317321 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317542 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317629 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317864 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.317953 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.318171 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.318268 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.318472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.318560 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.318779 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319088 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319174 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319399 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319487 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319706 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.319794 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320040 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320143 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320365 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320452 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320676 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320769 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.320981 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.321082 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.321294 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.321612 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.321698 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.321918 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322054 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322242 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322330 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322568 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322656 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322880 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.322975 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323198 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323284 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323499 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323587 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323799 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.323896 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324123 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324214 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324431 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324530 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324742 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.324842 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325043 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325131 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325342 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325428 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325640 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325728 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.325943 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326031 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326242 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326330 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326543 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326631 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326840 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.326927 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327136 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327224 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327445 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327533 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327743 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.327825 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328176 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328385 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328483 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328684 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328771 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.328981 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329077 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329280 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329366 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329580 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329701 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.329877 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330020 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330173 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330259 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330468 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330767 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.330861 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331062 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331147 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331360 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331445 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331662 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331757 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.331983 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332076 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332289 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332376 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332597 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332692 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332900 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.332987 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333202 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333296 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333504 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333593 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333815 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.333901 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334124 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334211 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334426 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334515 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334749 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.334835 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335052 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335147 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335356 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335444 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335659 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.335753 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336021 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336126 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336284 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336371 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336586 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336673 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336894 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.336988 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337212 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337304 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337515 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337602 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337824 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.337920 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338133 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338226 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338440 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338528 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338747 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.338835 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339051 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339137 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339372 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339465 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339677 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.339767 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340005 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340096 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340311 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340397 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340619 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340717 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.340927 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341014 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341237 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341332 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341543 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341629 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341848 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.341935 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342158 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342252 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342465 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342552 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342771 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.342863 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.343082 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.343178 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.343383 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.343475 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344229 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344542 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344631 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344853 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.344950 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345170 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345260 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345483 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345571 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345807 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.345894 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346113 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346198 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346420 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346509 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346719 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346806 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.346959 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:24:59.347055 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.347378 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.347690 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.348056 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.348385 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.348697 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.349009 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.349312 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:24:59.349555 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:24:59.500150 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Registered counter for database nova_api Nov 02 03:24:59.502131 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Registered counter for database nova_api Nov 02 03:24:59.521360 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.523175 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.528442 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.529775 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.585129 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.context [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9c6a98e-99ee-4bad-903f-8a98c80704c9(cell1) {{(pid=103775) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 03:24:59.586907 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.context [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9c6a98e-99ee-4bad-903f-8a98c80704c9(cell1) {{(pid=103776) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 03:24:59.589015 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:24:59.589488 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:24:59.590734 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:24:59.591054 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:24:59.591199 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:24:59.591761 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:24:59.592236 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:24:59.592804 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:24:59.593524 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:24:59.594501 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:24:59.594748 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:24:59.596495 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:24:59.596737 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Registered counter for database nova_cell0 Nov 02 03:24:59.598446 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Registered counter for database nova_cell0 Nov 02 03:24:59.600764 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Registered counter for database nova_cell1 Nov 02 03:24:59.602717 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Registered counter for database nova_cell1 Nov 02 03:24:59.608682 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.609895 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.613991 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.615397 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.616926 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.618391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.622025 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.623555 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.762649 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Registered counter for database nova_cell0 Nov 02 03:24:59.767828 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Registered counter for database nova_cell0 Nov 02 03:24:59.772525 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.774415 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:24:59.776894 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:24:59.778984 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:25:00.113497 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:25:00.114055 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:25:00.120727 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:25:00.120854 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:25:00.460507 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:25:00.461352 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:25:00.466438 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:25:00.467316 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:25:00.471762 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55954510d9c0 pid: 103776 (default app) Nov 02 03:25:00.472673 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55954510d9c0 pid: 103775 (default app) Nov 02 03:25:00.473814 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:25:00.474976 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-748f2037-a8ab-40d9-8c80-3b58761537a1 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Nov 02 03:25:00.475381 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Nov 2 03:25:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:21.405234 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:21.406375 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Nov 02 03:26:21.406779 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:21.418575 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:21.419784 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell1:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:21.422271 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell0:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:21.423373 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:22.312917 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-70a3a593-39f7-403d-a35b-64a163622842 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:22.346358 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-70a3a593-39f7-403d-a35b-64a163622842 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933526 Nov 02 03:26:22.347299 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 03:26:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:24.980522 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:24.982050 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-96522ed6-738c-4df7-bad8-d601208a6908 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Nov 02 03:26:24.982436 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:25.429408 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-32cf2c75-4eab-418a-94a1-80456c81ac54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:25.475705 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-32cf2c75-4eab-418a-94a1-80456c81ac54 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486876 Nov 02 03:26:25.476286 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:25.490803 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:25.491658 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell1:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:25.493665 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell0:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:25.494734 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:25.698539 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-0176e112-5612-46b5-9409-d29537630c5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:25.769379 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-0176e112-5612-46b5-9409-d29537630c5c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283640 Nov 02 03:26:25.769931 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 03:26:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:28.355412 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-32cf2c75-4eab-418a-94a1-80456c81ac54 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:28.356953 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-32cf2c75-4eab-418a-94a1-80456c81ac54 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Nov 02 03:26:28.357342 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:29.014567 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-5185d5f7-b9e4-4cf2-a3c0-8f69345fa66a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:29.053831 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-5185d5f7-b9e4-4cf2-a3c0-8f69345fa66a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689943 Nov 02 03:26:29.054664 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:29.068313 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-953e0728-3fd0-40ea-863f-739e8d67fc6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:29.109718 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-953e0728-3fd0-40ea-863f-739e8d67fc6f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045269 Nov 02 03:26:29.110419 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 03:26:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:26:31.709303 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-5185d5f7-b9e4-4cf2-a3c0-8f69345fa66a admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:31.710306 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-5185d5f7-b9e4-4cf2-a3c0-8f69345fa66a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 02 03:26:31.710713 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:32.135386 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-0c5a5ae0-ef7b-482a-b352-f3d4a1751241 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:32.155369 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-0c5a5ae0-ef7b-482a-b352-f3d4a1751241 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438595 Nov 02 03:26:32.156290 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 03:26:32.169236 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-8810056c-d9b1-4e6f-afe4-8d81c166bddf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:32.197055 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-8810056c-d9b1-4e6f-afe4-8d81c166bddf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032620 Nov 02 03:26:32.197646 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 03:26:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:34.818307 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-0c5a5ae0-ef7b-482a-b352-f3d4a1751241 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:34.819316 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-0c5a5ae0-ef7b-482a-b352-f3d4a1751241 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 02 03:26:34.820739 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:35.269408 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-9530f7fb-4ff0-46e4-bbed-50250ce15a5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:35.291196 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-9530f7fb-4ff0-46e4-bbed-50250ce15a5a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464710 Nov 02 03:26:35.299899 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:35.304807 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-72edf66a-4f21-45cf-80b6-906f75ff9b7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:35.333659 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-72edf66a-4f21-45cf-80b6-906f75ff9b7b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032681 Nov 02 03:26:35.334393 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 03:26:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:26:38.003775 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-9530f7fb-4ff0-46e4-bbed-50250ce15a5a admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:38.004791 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-9530f7fb-4ff0-46e4-bbed-50250ce15a5a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Nov 02 03:26:38.005193 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:38.437050 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:38.458339 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446634 Nov 02 03:26:38.458897 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:38.471504 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a347ecb3-be87-48c4-b086-f87e1dbfe625 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:38.495588 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a347ecb3-be87-48c4-b086-f87e1dbfe625 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027693 Nov 02 03:26:38.496240 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Nov 2 03:26:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:41.158448 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:41.159707 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001798 Nov 02 03:26:41.160285 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:41.618399 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d0eeb63d-860a-4951-bdff-1463e60f0693 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:41.643265 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d0eeb63d-860a-4951-bdff-1463e60f0693 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.475723 Nov 02 03:26:41.643799 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 03:26:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:26:44.207525 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:44.208495 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-913d82b9-d0a4-494b-92da-5166c85e851b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 02 03:26:44.208900 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:26:44.619134 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a8ab9487-5732-46b4-abcb-ab9cfd56c3d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "ram": 512, "disk": 1}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:44.639240 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a8ab9487-5732-46b4-abcb-ab9cfd56c3d3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424401 Nov 02 03:26:44.639773 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:44.652547 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-3e0b67b8-9fd7-4306-a9c0-21524f586db8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:44.678898 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-3e0b67b8-9fd7-4306-a9c0-21524f586db8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030585 Nov 02 03:26:44.679461 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 03:26:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:47.291407 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a8ab9487-5732-46b4-abcb-ab9cfd56c3d3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:47.292553 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a8ab9487-5732-46b4-abcb-ab9cfd56c3d3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Nov 02 03:26:47.292954 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:47.670663 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-dcbd8a9f-29de-42c2-ad3e-883fbcc1627d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:47.689041 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-dcbd8a9f-29de-42c2-ad3e-883fbcc1627d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.390042 Nov 02 03:26:47.695052 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 03:26:47.702125 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-c2f40e6f-44f4-4d86-b4e4-3a83f186222a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:47.725688 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-c2f40e6f-44f4-4d86-b4e4-3a83f186222a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027647 Nov 02 03:26:47.726607 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 03:26:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:50.385912 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-dcbd8a9f-29de-42c2-ad3e-883fbcc1627d admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:50.388106 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-dcbd8a9f-29de-42c2-ad3e-883fbcc1627d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002670 Nov 02 03:26:50.388505 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:50.826558 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-08d844af-e3ed-441e-88e6-784e8d2804ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "vcpus": 2}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:50.849877 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-08d844af-e3ed-441e-88e6-784e8d2804ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455363 Nov 02 03:26:50.850509 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:50.863402 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-4e44ab66-b1e6-416c-8fd7-9783255c46b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:50.891748 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-4e44ab66-b1e6-416c-8fd7-9783255c46b7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032682 Nov 02 03:26:50.892694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 03:26:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:26:53.567224 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-08d844af-e3ed-441e-88e6-784e8d2804ea admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:53.568264 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-08d844af-e3ed-441e-88e6-784e8d2804ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 02 03:26:53.569046 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:54.012623 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-35cdd567-9357-47f4-ac82-c73cf587e3e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:54.018600 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:54.035276 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-35cdd567-9357-47f4-ac82-c73cf587e3e1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460056 Nov 02 03:26:54.036029 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:54.048484 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-874c8fa2-e787-4a83-aeb0-b9523424678c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:54.099396 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-874c8fa2-e787-4a83-aeb0-b9523424678c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054443 Nov 02 03:26:54.104006 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 03:26:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:26:56.691062 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-35cdd567-9357-47f4-ac82-c73cf587e3e1 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:26:56.692119 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-35cdd567-9357-47f4-ac82-c73cf587e3e1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 02 03:26:56.693737 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:26:57.211648 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "name": "m1.xlarge"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:57.220373 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:57.244077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543589 Nov 02 03:26:57.244738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Nov 2 03:26:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:26:57.257794 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-23b6f5f9-2a8b-4967-a80c-74bd4fac20ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:26:57.287682 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-23b6f5f9-2a8b-4967-a80c-74bd4fac20ec admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034282 Nov 02 03:26:57.288403 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Nov 2 03:26:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:27:13.881565 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:13.882580 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 02 03:27:13.882983 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:13.893848 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:14.267543 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-e5656ebb-f6b7-4b2e-af64-2d403ccd9283 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:14.285230 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-e5656ebb-f6b7-4b2e-af64-2d403ccd9283 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395833 Nov 02 03:27:14.285759 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 03:27:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:15.570244 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:15.571267 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-67a5e680-b423-4d64-954e-6068011add2f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 02 03:27:15.571660 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:16.096712 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7dea7cbd-fc99-4272-87f9-2a974dbfca72 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:16.101902 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-7dea7cbd-fc99-4272-87f9-2a974dbfca72 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7dea7cbd-fc99-4272-87f9-2a974dbfca72 admin admin] Request method failure captured: Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept: application/json Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.26 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjYeOTwuAq4FQmPyptH4DCvG7Rda9YOGArwb_8kGtXnkGAxUd1VTGXGUTWzZT3YSiPRJwalFrUSzMgTVxxE98qspEFmUNQ8oaSAuVviDNu20Hj_xov2DlShuHAA9hxOzclXSThxMHULRR3-7Bdpo3cQtsF4jF9UYG145LlP_VIYQrM_4M Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Role: member,reader,admin Nov 02 03:27:16.105117 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Roles: member,reader,admin Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User: admin Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: method: > Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: exception: Flavor 42 could not be found. Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '42'} Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:16.106760 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:16.107994 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.109494 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7dea7cbd-fc99-4272-87f9-2a974dbfca72 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:16.111071 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7dea7cbd-fc99-4272-87f9-2a974dbfca72 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389353 Nov 02 03:27:16.111071 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 03:27:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 03:27:16.116661 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-61548915-8ac8-4c4f-aaea-1bf83eb3a0e6 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:16.138609 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-61548915-8ac8-4c4f-aaea-1bf83eb3a0e6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025810 Nov 02 03:27:16.139138 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:16.149413 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7e86b0ab-4aa7-41a5-a15f-5c1e66eac131 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:16.171292 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7e86b0ab-4aa7-41a5-a15f-5c1e66eac131 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026309 Nov 02 03:27:16.171829 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:27:16.180956 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-2c51eb9d-778a-4ad5-9e57-3a79ec91ff76 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:16.186205 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-2c51eb9d-778a-4ad5-9e57-3a79ec91ff76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-2c51eb9d-778a-4ad5-9e57-3a79ec91ff76 admin admin] Request method failure captured: Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept: application/json Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.26 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjYeOTwuAq4FQmPyptH4DCvG7Rda9YOGArwb_8kGtXnkGAxUd1VTGXGUTWzZT3YSiPRJwalFrUSzMgTVxxE98qspEFmUNQ8oaSAuVviDNu20Hj_xov2DlShuHAA9hxOzclXSThxMHULRR3-7Bdpo3cQtsF4jF9UYG145LlP_VIYQrM_4M Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Role: member,reader,admin Nov 02 03:27:16.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Roles: member,reader,admin Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User: admin Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: method: > Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: exception: Flavor 42 could not be found. Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '42'} Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:16.191077 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:16.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:16.193836 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-2c51eb9d-778a-4ad5-9e57-3a79ec91ff76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:16.195073 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-2c51eb9d-778a-4ad5-9e57-3a79ec91ff76 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013364 Nov 02 03:27:16.195073 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 03:27:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:17.377737 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7e86b0ab-4aa7-41a5-a15f-5c1e66eac131 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:17.378763 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7e86b0ab-4aa7-41a5-a15f-5c1e66eac131 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 02 03:27:17.379154 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:17.899026 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b7c5283f-7aa3-4953-a156-7e65558b2273 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:17.903974 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-b7c5283f-7aa3-4953-a156-7e65558b2273 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b7c5283f-7aa3-4953-a156-7e65558b2273 admin admin] Request method failure captured: Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept: application/json Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.26 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjYeOVPzr85oJEaEPZ_ZHF4dPFvFJnAYiePWneSVJLpaSqsMWPkfrDzPf7zRatEbqX8krQh4c5lF6quuXzF6p864awS_M8FroTKkL_-pYDA0okQSMe9KgZCZQv0JMtEZi3_ASlokFQjhu-hgPaui7flyrNAvXd6iJNvqdQ04TBlwJO3sM Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Role: member,reader,admin Nov 02 03:27:17.905490 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Roles: member,reader,admin Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User: admin Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: method: > Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: exception: Flavor 84 could not be found. Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '84'} Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:17.906976 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:17.908084 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.909738 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b7c5283f-7aa3-4953-a156-7e65558b2273 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:17.910947 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b7c5283f-7aa3-4953-a156-7e65558b2273 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392667 Nov 02 03:27:17.910947 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 03:27:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:17.916594 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-6db481c8-c070-4c90-a44b-dbf9a26901b1 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:17.931249 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-6db481c8-c070-4c90-a44b-dbf9a26901b1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018352 Nov 02 03:27:17.931780 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:17.941729 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-e5c6c720-e107-4213-92b0-fe18136ce4ac admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:17.957374 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-e5c6c720-e107-4213-92b0-fe18136ce4ac admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019186 Nov 02 03:27:17.957903 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:17.966680 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-6e8730b4-f33c-4ab7-aa52-d8618ce98e74 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:17.971517 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-6e8730b4-f33c-4ab7-aa52-d8618ce98e74 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-6e8730b4-f33c-4ab7-aa52-d8618ce98e74 admin admin] Request method failure captured: Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept: application/json Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.26 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjYeOVPzr85oJEaEPZ_ZHF4dPFvFJnAYiePWneSVJLpaSqsMWPkfrDzPf7zRatEbqX8krQh4c5lF6quuXzF6p864awS_M8FroTKkL_-pYDA0okQSMe9KgZCZQv0JMtEZi3_ASlokFQjhu-hgPaui7flyrNAvXd6iJNvqdQ04TBlwJO3sM Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Role: member,reader,admin Nov 02 03:27:17.973049 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Roles: member,reader,admin Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User: admin Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: method: > Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: exception: Flavor 84 could not be found. Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '84'} Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:17.974628 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:17.975694 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:17.977035 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-6e8730b4-f33c-4ab7-aa52-d8618ce98e74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:17.978222 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-6e8730b4-f33c-4ab7-aa52-d8618ce98e74 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011209 Nov 02 03:27:17.978222 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Nov 2 03:27:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:19.159857 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-e5c6c720-e107-4213-92b0-fe18136ce4ac admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:19.160903 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-e5c6c720-e107-4213-92b0-fe18136ce4ac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 02 03:27:19.161291 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:19.679581 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-0f1d2487-bb26-47fa-a9bc-2d2dee6f2aa8 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:19.685349 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-0f1d2487-bb26-47fa-a9bc-2d2dee6f2aa8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-0f1d2487-bb26-47fa-a9bc-2d2dee6f2aa8 admin admin] Request method failure captured: Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept: application/json Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.26 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjYeOXYk5sbMrBM4htsLYzrF9m98vDxglJxne6fzJJBB9McsJtrVT6GRWMf53_l07RLCnFGne4hHkAvKpHmwzwKKP7wzEBb1cg22Tx_gEnffR4wkazZEyy_rI75-A3z_Z2uvW_1N5l20Qoe25WJeA5CtNRVdkad7rwJ0rP3V52G9_G_Zw Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Role: member,reader,admin Nov 02 03:27:19.686821 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Roles: member,reader,admin Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User: admin Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: method: > Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: exception: Flavor 451 could not be found. Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '451'} Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:19.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:19.689263 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.690435 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-0f1d2487-bb26-47fa-a9bc-2d2dee6f2aa8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:19.691465 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-0f1d2487-bb26-47fa-a9bc-2d2dee6f2aa8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388274 Nov 02 03:27:19.691465 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:27:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:19.698258 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-e598fdef-404b-4f93-801c-39bead171c6d admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:19.713997 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-e598fdef-404b-4f93-801c-39bead171c6d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019170 Nov 02 03:27:19.714508 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:19.723688 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:19.738597 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018363 Nov 02 03:27:19.739132 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Nov 2 03:27:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:27:19.748373 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ab34cca9-333d-4a19-ada6-32b0b4142825 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:19.753289 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-ab34cca9-333d-4a19-ada6-32b0b4142825 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ab34cca9-333d-4a19-ada6-32b0b4142825 admin admin] Request method failure captured: Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept: application/json Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.26 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjYeOXYk5sbMrBM4htsLYzrF9m98vDxglJxne6fzJJBB9McsJtrVT6GRWMf53_l07RLCnFGne4hHkAvKpHmwzwKKP7wzEBb1cg22Tx_gEnffR4wkazZEyy_rI75-A3z_Z2uvW_1N5l20Qoe25WJeA5CtNRVdkad7rwJ0rP3V52G9_G_Zw Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Role: member,reader,admin Nov 02 03:27:19.754768 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Roles: member,reader,admin Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90ca3cc9c54d44feb93e6ed209b99483"}]}] Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 90ca3cc9c54d44feb93e6ed209b99483 Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User: admin Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Id: cc903821fbc442d9b4a30f92f10f1b17 Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: method: > Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: exception: Flavor 451 could not be found. Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '451'} Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:27:19.756391 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:19.757317 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Nov 02 03:27:19.758394 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ab34cca9-333d-4a19-ada6-32b0b4142825 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:27:19.759473 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-ab34cca9-333d-4a19-ada6-32b0b4142825 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011273 Nov 02 03:27:19.759473 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:27:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:20.942564 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:20.943566 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 02 03:27:20.943981 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:21.464401 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-657dcb00-dc19-4c50-be79-21d8cf927565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:27:21.483427 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-657dcb00-dc19-4c50-be79-21d8cf927565 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402567 Nov 02 03:27:21.484014 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 03:27:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:27:22.701681 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:22.702688 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 02 03:27:22.703089 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:23.243864 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-0abecedf-8d33-4fb2-9e57-977a94e7c749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:27:23.263462 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-0abecedf-8d33-4fb2-9e57-977a94e7c749 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.420588 Nov 02 03:27:23.263942 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 03:27:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 03:27:24.453558 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:24.454554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Nov 02 03:27:24.454954 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:24.968938 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-9d0cfe0f-829e-4e2d-8f5c-90e3e219333d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:27:24.987144 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-9d0cfe0f-829e-4e2d-8f5c-90e3e219333d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395668 Nov 02 03:27:24.987674 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 03:27:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:27:26.189588 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:26.190596 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 02 03:27:26.190992 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:26.708242 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-05c26b2f-0096-4295-82f1-fb7895906482 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:27:26.727037 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-05c26b2f-0096-4295-82f1-fb7895906482 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399539 Nov 02 03:27:26.727583 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Nov 2 03:27:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 03:27:27.916910 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:27.917906 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 02 03:27:27.918298 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:27:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:27:28.433927 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-190249d8-1d9b-44d3-90d0-64ff871cf26f admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:27:28.453860 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-190249d8-1d9b-44d3-90d0-64ff871cf26f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399783 Nov 02 03:27:28.454397 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Nov 2 03:27:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:28:24.377732 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.378729 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-be7a1bc7-acea-43c7-b063-db94d9f02cff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 02 03:28:24.379126 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:28:24.389643 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:24.785921 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a3022bb2-e7ac-4035-abac-007d59bbfc5e admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.806611 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a3022bb2-e7ac-4035-abac-007d59bbfc5e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421448 Nov 02 03:28:24.807140 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:28:24.829046 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=14 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:24.833013 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-4fff155d-0a1d-4044-8070-af535c895a8f admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.840861 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-4fff155d-0a1d-4044-8070-af535c895a8f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013426 Nov 02 03:28:24.841387 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:28:24.853179 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-77b66d18-eb18-4957-95a0-06dace2c54ef admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.860403 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-77b66d18-eb18-4957-95a0-06dace2c54ef admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010820 Nov 02 03:28:24.860920 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:28:24.872483 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.879812 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010882 Nov 02 03:28:24.880374 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:28:24.892343 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-bb10cdd6-20da-4338-8708-431ea858beab admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:28:24.899469 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-bb10cdd6-20da-4338-8708-431ea858beab admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010698 Nov 02 03:28:24.900027 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Nov 2 03:28:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:31:26.097195 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:26.098185 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Nov 02 03:31:26.098570 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:31:26.237579 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=6 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:26.401844 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:26.406869 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:26.407341 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:26.407803 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:26.408559 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:26.409003 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:26.409420 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:26.442734 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d920ec2c-d5a1-4ce0-8dfe-5773314c8d5d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.206368 Nov 02 03:31:26.443302 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:31:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:31:27.510580 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:27.511590 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 02 03:31:27.512019 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:31:27.705231 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:27.708675 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:27.709157 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:27.709586 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:27.710303 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:27.710747 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:27.711159 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:27.730776 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-1eb6d532-57f3-40cb-8c95-fcfa89e955da admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076932 Nov 02 03:31:27.731247 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:31:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:31:39.210168 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:39.211164 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Nov 02 03:31:39.211554 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:31:39.352884 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell0:SELECT=4 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:39.353605 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell1:SELECT=4 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:39.354216 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=8 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:39.402425 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:39.405825 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:39.406300 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:39.406723 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:39.407438 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:39.407880 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:39.408321 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:39.432637 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-2031a83a-aba8-4440-948f-f8dbdcae2df2 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084157 Nov 02 03:31:39.433127 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:31:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:31:40.484039 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:40.485066 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ed37bf2f-f241-40b7-aef3-3f7e32ad54d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 02 03:31:40.485493 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Nov 2 03:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:31:40.674801 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:31:40.678325 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:40.678804 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:40.679232 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:40.679990 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:31:40.680422 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:31:40.680839 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:31:40.702922 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a759880f-a7b4-4873-ac85-74d56f564246 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079527 Nov 02 03:31:40.703419 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Nov 2 03:31:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:32:37.839190 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: Wed Nov 2 03:32:37 2022 - graceful shutdown triggered... Nov 02 03:32:37.839323 dv-cinder-860209-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 03:32:37.840313 dv-cinder-860209-6-iscsi devstack@n-api.service[103775]: Gracefully killing worker 1 (pid: 103775)... Nov 02 03:32:37.840915 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: Gracefully killing worker 2 (pid: 103776)... Nov 02 03:32:37.967369 dv-cinder-860209-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=4 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:32:38.841493 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: worker 1 buried after 1 seconds Nov 02 03:32:38.841493 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: worker 2 buried after 1 seconds Nov 02 03:32:38.841493 dv-cinder-860209-6-iscsi devstack@n-api.service[103774]: goodbye to uWSGI. Nov 02 03:32:38.842931 dv-cinder-860209-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 03:32:38.843495 dv-cinder-860209-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 03:32:38.846236 dv-cinder-860209-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 03:32:38.860292 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 03:32:38 2022] *** Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: nodename: dv-cinder-860209-6-iscsi Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: machine: x86_64 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: clock source: unix Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: pcre jit disabled Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: detected number of CPU cores: 4 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: current working directory: / Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: detected binary path: /usr/bin/uwsgi-core Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: your processes number limit is 47680 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: your memory page size is 4096 bytes Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: detected max file descriptor number: 2048 Nov 02 03:32:38.862643 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: lock engine: pthread robust mutexes Nov 02 03:32:38.864076 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: thunder lock: enabled Nov 02 03:32:38.864076 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 03:32:38.864076 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 03:32:38.906136 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: Python main interpreter initialized at 0x55964f2d59c0 Nov 02 03:32:38.906136 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: python threads support enabled Nov 02 03:32:38.906136 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: your server socket listen backlog is limited to 100 connections Nov 02 03:32:38.906136 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: your mercy for graceful operations on workers is 90 seconds Nov 02 03:32:38.906601 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 03:32:38.906601 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: *** Operational MODE: preforking *** Nov 02 03:32:38.906850 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: *** uWSGI is running in multiple interpreter mode *** Nov 02 03:32:38.906850 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: spawned uWSGI master process (pid: 125389) Nov 02 03:32:38.907054 dv-cinder-860209-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 03:32:38.907933 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: spawned uWSGI worker 1 (pid: 125410, cores: 1) Nov 02 03:32:38.908082 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: spawned uWSGI worker 2 (pid: 125411, cores: 1) Nov 02 03:32:38.908307 dv-cinder-860209-6-iscsi devstack@n-api.service[125389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 03:32:39.571224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 03:32:39.572439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 03:32:40.817526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:32:40.817526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: from cryptography.utils import int_from_bytes Nov 02 03:32:40.818243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:32:40.818243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: from cryptography.utils import int_from_bytes Nov 02 03:32:40.828826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:32:40.828826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: from cryptography.utils import int_from_bytes Nov 02 03:32:40.829292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:32:40.829292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: from cryptography.utils import int_from_bytes Nov 02 03:32:43.215882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:32:43.216767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:32:43.217304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:32:43.217676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:32:43.217931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:32:43.218319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.218646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.218968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.219288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.219617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.219926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.220273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.220691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.221021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.221282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.221597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.221919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-6-iscsi {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.222240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.222546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.222855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.223172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.223476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.223796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.224131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.224629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.225081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.225390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.225700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.226039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.226354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.226659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.226975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.227280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.227603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.227928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.228333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-6-iscsi {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.228649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.228959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.229274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.229683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.229996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.230307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.230625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.230944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.231265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.231584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.231901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.232259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.232578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.232879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.233185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.233493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.233808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.234116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.234419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.234666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.234970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.235287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.235604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.235926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.236725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.236974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.237292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.237609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.237919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.238225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.238598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.238886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.239138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.239442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.239915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.240250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.240569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.240884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.241205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.241517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.241838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.242230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.242481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.242788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.244939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.245242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.245559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.245879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.246185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.246693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.246996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.247296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.247611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.247916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.248243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.248738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.249034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.249349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.249636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.249945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.250251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.250547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.250873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.251163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.251470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.252411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.252538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:32:43.252952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:32:43.253067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.253067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.253242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:32:43.253326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.253599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:32:43.253717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.253846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:32:43.253946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.254939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.255867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.256819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-6-iscsi {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.257945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.258971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.259869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.260946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.261986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.262917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.263138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.263239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.263445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.263541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.263795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.263896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-6-iscsi {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.264148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.264254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.264463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.264564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.264787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.264885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.265113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.265211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.265429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.265528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.265739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.265839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.266053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.266145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.266383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.266474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.266694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.266794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.267003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.267101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.267341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.267529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.267662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.267808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.268066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.268337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.268436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.268685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.268946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.269090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.269273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.269506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.269613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.269914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.270018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.270244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.270585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.270693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.270946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.271091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.271247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.271372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.271548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.271745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.272045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.272162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.272374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.272562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.272698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.272844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.273012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.273273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.273366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.273576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.273676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.273956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.274046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.274270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.274582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.274678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.274900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.275182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.275282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.275519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.275609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.275831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.275923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.276168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.276272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.276486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.276584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.276800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.276892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.277114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.277213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.277441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.277551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.277750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.277852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.278071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.278162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.278386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.278486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.278697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.278798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.279013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.279117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.279325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.279425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.279636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.279738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.279965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.280072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.280728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.280830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.280926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.281025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.281165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.281253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.281337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.281420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.281513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.281654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.281751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.281902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.282051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.282217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.282359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.282571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.282720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.282914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.283010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.283250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.283351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.283581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.283672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.283895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.284032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.284180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.284283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.284490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.284582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.284802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.284895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.285112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.285203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.285432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.285530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.285740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.285831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.286046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.286138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.286353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.286453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.286666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.286764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.286972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.287077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.287284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.287381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.287596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.287710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.287904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.288029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.288241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.288333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.288551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.288650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.288863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.288968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.289173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.289275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.289481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.289579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.289803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.289903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.290130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.290229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.290434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.290532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.290744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.290842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.291055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.291154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.291367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.291466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.291667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.291810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.291994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.292104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.292303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.292397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.292609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.292701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.292914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.293020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.293223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.293321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.293527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.293627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.293832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.293981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.294133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.294272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.294437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.294531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.294740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.294909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.295050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.295141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.295354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.295446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.295659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.295752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.295977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.296070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.296290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.296391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.296602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.296705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.296913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.297004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.297224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.297321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.297532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.297637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.297842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.297945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.298143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.298234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.298981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.299085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.299322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.299421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.299635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.299740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.300056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.300152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.300282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.300385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.300596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.300700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:32:43.300918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.301962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.302970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.303867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.304857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.305995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.306935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.307994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.308928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.309864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.310821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.311760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.312921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.313938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.314705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.314854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.315978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.316936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.317984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.318871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.319801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.320991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.321925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.322973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.323986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.324155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.324314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.324465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.324615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.324782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.325903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.326940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.327194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.327418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.327539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.327753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.327877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.328887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.329876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.330804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.331929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.332975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.333889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.334798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.335985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.336861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.337993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.338979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.339969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.340940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.341859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.342880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.343808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.344952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.345901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.346918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.347833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.348797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.349922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.350937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.351873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.352887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.353924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.354929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.355831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.356913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.357861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.358817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.359994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.360898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.361514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.361749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.361850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.362819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.363974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.364143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.364288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.364447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.364588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.364877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.365966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.366817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.367976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.368922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.369958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.370148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.370250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.370460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.370770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.370861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.371079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.371172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.371640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.371772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.371970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.372919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.373024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.373246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.373341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.373541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.373661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.374881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.375866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.376105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.376205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.376413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.376511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.377289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.377421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.377623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.377718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.377932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.378959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.379993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.380879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.381829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.382989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.383927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.384991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.385928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.386860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.387820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.388993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.389928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.390946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.391856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.392996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.393133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.393358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.393558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.393654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.393953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.394124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.394343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.394584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.394686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.394890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.395995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.396199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.396335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.396535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.396862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.396980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.397982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.398135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.398440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.398533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.398743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.399965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.400862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.401842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.402981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.403077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.403283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.403393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.403625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.403719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.404986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.405926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.406877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.407861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.408916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.409981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.410910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.411124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.411226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.411434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.411744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.411846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.412824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.413798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.414989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.415920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.416881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.417820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.418904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.419943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.420920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.421096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.421428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.421529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.421739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.421839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.422800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.423016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.423111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.423332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.423985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.424894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.425810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.426956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.427141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.427264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.427465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.427796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.427891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.428881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.429816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.430960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.431992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.432912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.433848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.434963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.435867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.436925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.437857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.438800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.439026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.439160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.439919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.440976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.441962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.442941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.443902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.444976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.445910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.446845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.447764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.448915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.449975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.450148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.450259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.450484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.450694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.450790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.451817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.452943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.453998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.454188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.454289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.454538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.454638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.454895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.455993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.456933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.457895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.458846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.459991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.460932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.461940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.462855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.463990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.464937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.465912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.466800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.467770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.468957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.469967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.470991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.471918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.472872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.473945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.474872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.475868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.476918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.477976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.478985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.479884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.480811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.481970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.482072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.482211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:32:43.482315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.482593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.482949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.483273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.483813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.484191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.484520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.484858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.485201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.485512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.485825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.486653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.486986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.487302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.487622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.487939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.488278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.488595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.488915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.489230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.489545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.489860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.490175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.490493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.490808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.491138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.491436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.491757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.492129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.492458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.492783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.493105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.493428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.493744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.494059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.494374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.494695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.495016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.495353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.495669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.496005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.496688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.497011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.497339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.497667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.497987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.498314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.498644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.498962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.499292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.499607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.499943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.500309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.500644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.500974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.501291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.501620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.502449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.502767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.503094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.503411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.503725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.504062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.504381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.504697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.505009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.505321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.505629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.505942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.506252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.506561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.506873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.507183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.507492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.507818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.508145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.508458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.508769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.509078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.509391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.509697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.510033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.510371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.510696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.511027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.511346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.511677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.512013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.512346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.512675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.512996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.513315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.513651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.513969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.514286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.514604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.514925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.515240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.515556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.515886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.516281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.516569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.516900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.517264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.517575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.517898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.518214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.518548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.518865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.519182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.519499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.519816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.520160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.520484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.520803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.521122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.521445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.521769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.522103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.522434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.522751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.523089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.523426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.523778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.524140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.524498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.524843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.525165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.525587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.525795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:32:43.526042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:32:43.544382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO dbcounter [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Registered counter for database nova_api Nov 02 03:32:43.565187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_db.sqlalchemy.engines [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.571871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writer thread running {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.589066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO dbcounter [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Registered counter for database nova_api Nov 02 03:32:43.609079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_db.sqlalchemy.engines [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.616334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writer thread running {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.628030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.context [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9c6a98e-99ee-4bad-903f-8a98c80704c9(cell1) {{(pid=125411) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 03:32:43.632035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:32:43.632509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:32:43.634082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:32:43.634793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:32:43.635233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:32:43.637265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:32:43.639241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO dbcounter [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Registered counter for database nova_cell0 Nov 02 03:32:43.643319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO dbcounter [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Registered counter for database nova_cell1 Nov 02 03:32:43.650587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_db.sqlalchemy.engines [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.652490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_db.sqlalchemy.engines [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.659343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writer thread running {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.660802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writer thread running {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.673058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.context [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9c6a98e-99ee-4bad-903f-8a98c80704c9(cell1) {{(pid=125410) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 03:32:43.677669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:32:43.678149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:32:43.679755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:32:43.680509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:32:43.680963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:32:43.682991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:32:43.685016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO dbcounter [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Registered counter for database nova_cell0 Nov 02 03:32:43.689143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO dbcounter [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Registered counter for database nova_cell1 Nov 02 03:32:43.696429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_db.sqlalchemy.engines [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.698138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_db.sqlalchemy.engines [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.703721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writer thread running {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.706317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writer thread running {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.811714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO dbcounter [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Registered counter for database nova_cell0 Nov 02 03:32:43.818506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_db.sqlalchemy.engines [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.823196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writer thread running {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:43.852504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO dbcounter [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Registered counter for database nova_cell0 Nov 02 03:32:43.859667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_db.sqlalchemy.engines [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:32:43.864913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writer thread running {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:32:44.144629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: WARNING keystonemiddleware.auth_token [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:32:44.151869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: WARNING keystonemiddleware.auth_token [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:32:44.190574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: WARNING keystonemiddleware.auth_token [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:32:44.197886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: WARNING keystonemiddleware.auth_token [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:32:44.493317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: WARNING keystonemiddleware.auth_token [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:32:44.499539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: WARNING keystonemiddleware.auth_token [None req-2b17d0bd-b2aa-4641-a4af-6e31744fe29a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:32:44.505365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55964f2d59c0 pid: 125411 (default app) Nov 02 03:32:44.541119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: WARNING keystonemiddleware.auth_token [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 03:32:44.547143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: WARNING keystonemiddleware.auth_token [None req-8518e84d-84eb-47da-9583-312f9154a300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 03:32:44.552503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55964f2d59c0 pid: 125410 (default app) Nov 02 03:33:19.443540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:19.444654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:19.445755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:19.446756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:20.688583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e24142dd-5de9-48b5-8bbf-d31103c95051 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Action: 'create', calling method: .version_select at 0x7f5c9343eee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-80812777"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:22.795405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e24142dd-5de9-48b5-8bbf-d31103c95051 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.357697 Nov 02 03:33:22.796355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Nov 2 03:33:19 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3360 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 03:33:22.815423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:22.816272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:22.819559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:22.824441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:23.269324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1ada03b5-9d1b-495e-b49a-ce2215a3962e tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c933bbc10>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:24.036390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1ada03b5-9d1b-495e-b49a-ce2215a3962e tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 200 len: 344 microversion: 2.1 time: 1.227694 Nov 02 03:33:24.045867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:33:22 2022] GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 344 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:24.051942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c46526c9-1c1b-44c5-8e48-1005fea550d1 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Action: 'create', calling method: .version_select at 0x7f5c9324eca0>, body: {"snapshot": {"volume_id": "c97c0dde-cce9-4f6e-ba0b-e7235e784bdd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1260556794"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:24.435220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c46526c9-1c1b-44c5-8e48-1005fea550d1 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.388050 Nov 02 03:33:24.442607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1162 bytes} [Wed Nov 2 03:33:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:33:24.451092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cba4f823-b31c-425e-9142-2239d2e0e86b tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c93287d30>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:24.599821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cba4f823-b31c-425e-9142-2239d2e0e86b tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 287 microversion: 2.1 time: 0.153704 Nov 02 03:33:24.600439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:24 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:24.613395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6d29af91-d202-4514-8750-5d02dc0126ba tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e0f70>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:24.714703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6d29af91-d202-4514-8750-5d02dc0126ba tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.107029 Nov 02 03:33:24.715591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Nov 2 03:33:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:33:24.728386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-063a643c-af9f-4d4d-8812-73082ebf297e tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c932414c0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:24.777744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-063a643c-af9f-4d4d-8812-73082ebf297e tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 287 microversion: 2.1 time: 0.054393 Nov 02 03:33:24.780057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:24 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:25.791922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3e6cddac-66d2-451f-977d-7ba4f37d452f tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e8ca0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:25.839121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3e6cddac-66d2-451f-977d-7ba4f37d452f tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 287 microversion: 2.1 time: 0.050891 Nov 02 03:33:25.839680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:25 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:26.859767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4d0d89d0-c982-41c8-b20d-43ca0e22aced tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c93287dc0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:27.478712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4d0d89d0-c982-41c8-b20d-43ca0e22aced tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 287 microversion: 2.1 time: 0.627880 Nov 02 03:33:27.481775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:26 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 287 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:28.493677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-520272b1-57f3-4a9d-8d4d-2561e159f3bf tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e84c0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:28.576546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-520272b1-57f3-4a9d-8d4d-2561e159f3bf tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 288 microversion: 2.1 time: 0.087522 Nov 02 03:33:28.577269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:28 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:28.588584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9f6144b1-7ccc-4059-b703-c0c24783c272 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c932413a0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:28.776585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9f6144b1-7ccc-4059-b703-c0c24783c272 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 202 len: 0 microversion: 2.1 time: 0.191663 Nov 02 03:33:28.777742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Nov 2 03:33:28 2022] DELETE /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:33:28.785653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-14462513-69c4-439b-bbfb-d7150df04f2f tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e0dc0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:28.850130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-14462513-69c4-439b-bbfb-d7150df04f2f tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 200 len: 287 microversion: 2.1 time: 0.068407 Nov 02 03:33:28.851405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:28 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:29.863557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b87da0c3-fdc2-4936-b0a6-d7f2d069bcaa tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c93241c10>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:29.921399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-b87da0c3-fdc2-4936-b0a6-d7f2d069bcaa tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] HTTP exception thrown: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b87da0c3-fdc2-4936-b0a6-d7f2d069bcaa tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Request method failure captured: Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 HTTP/1.1 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeT_z-QJjNIX9kKyiTCKgoo4gxbb5R5lPlLurUXnY54uXfeaOFRfDBjNSX9SqFSiTKW1byfelgocLxRA6PSF0LAryKj2DIknXAEpIhHOYq5y87gp9FtXDTVQV0vDVw9JwfZXa8rorcXMvnACzgE3FK_N2OMhAWxxzZwWK8d-VZY7LMI Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:33:29.926047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7961886d30c449aad4197024105a951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7961886d30c449aad4197024105a951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}] Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: a820200be2114b1db5d350ead6625bf1 Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '8bbfcaa4-bcda-41a8-98c9-39993be6ae25'} Nov 02 03:33:29.927943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. (HTTP 404) (Request-ID: req-7b23876a-4518-4637-9133-292897b2a300) Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.929052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:29.930442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 03:33:29.931881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:29.933750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b87da0c3-fdc2-4936-b0a6-d7f2d069bcaa tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Returning 404 to user: Snapshot 8bbfcaa4-bcda-41a8-98c9-39993be6ae25 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:33:29.935519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b87da0c3-fdc2-4936-b0a6-d7f2d069bcaa tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25" status: 404 len: 111 microversion: 2.1 time: 0.076639 Nov 02 03:33:29.945191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a11f16dc-26ec-4557-8972-d062d9d1c485 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e8310>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:29.949988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 03:33:29 2022] GET /compute/v2.1/os-snapshots/8bbfcaa4-bcda-41a8-98c9-39993be6ae25 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:33:30.118134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a11f16dc-26ec-4557-8972-d062d9d1c485 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 202 len: 0 microversion: 2.1 time: 0.177509 Nov 02 03:33:30.119337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:33:29 2022] DELETE /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:33:30.129064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de4142bc-9b44-4608-9359-649c0b3cded0 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931a9670>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:30.257774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de4142bc-9b44-4608-9359-649c0b3cded0 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 200 len: 343 microversion: 2.1 time: 0.133904 Nov 02 03:33:30.258543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:33:30 2022] GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 343 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:31.275216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a038494f-ac5e-4b17-b623-2efc6a983a42 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e8c10>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:31.371079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-a038494f-ac5e-4b17-b623-2efc6a983a42 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] HTTP exception thrown: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a038494f-ac5e-4b17-b623-2efc6a983a42 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Request method failure captured: Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd HTTP/1.1 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeT_z-QJjNIX9kKyiTCKgoo4gxbb5R5lPlLurUXnY54uXfeaOFRfDBjNSX9SqFSiTKW1byfelgocLxRA6PSF0LAryKj2DIknXAEpIhHOYq5y87gp9FtXDTVQV0vDVw9JwfZXa8rorcXMvnACzgE3FK_N2OMhAWxxzZwWK8d-VZY7LMI Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:33:31.378404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7961886d30c449aad4197024105a951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7961886d30c449aad4197024105a951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}] Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: a820200be2114b1db5d350ead6625bf1 Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'c97c0dde-cce9-4f6e-ba0b-e7235e784bdd'} Nov 02 03:33:31.380035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. (HTTP 404) (Request-ID: req-429e5709-3985-4282-9d65-cdfcbde1b2e7) Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.380998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:31.382337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 03:33:31.383621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.384961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.386800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a038494f-ac5e-4b17-b623-2efc6a983a42 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Returning 404 to user: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:33:31.388036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a038494f-ac5e-4b17-b623-2efc6a983a42 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 404 len: 109 microversion: 2.1 time: 0.118425 Nov 02 03:33:31.391169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:33:31 2022] GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:33:31.406783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2630b055-10b1-428f-b88c-e2b619e8f635 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931a9d30>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:31.482382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-2630b055-10b1-428f-b88c-e2b619e8f635 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] HTTP exception thrown: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2630b055-10b1-428f-b88c-e2b619e8f635 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Request method failure captured: Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd HTTP/1.1 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeT_z-QJjNIX9kKyiTCKgoo4gxbb5R5lPlLurUXnY54uXfeaOFRfDBjNSX9SqFSiTKW1byfelgocLxRA6PSF0LAryKj2DIknXAEpIhHOYq5y87gp9FtXDTVQV0vDVw9JwfZXa8rorcXMvnACzgE3FK_N2OMhAWxxzZwWK8d-VZY7LMI Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:33:31.486058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7961886d30c449aad4197024105a951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7961886d30c449aad4197024105a951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}] Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: a820200be2114b1db5d350ead6625bf1 Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'c97c0dde-cce9-4f6e-ba0b-e7235e784bdd'} Nov 02 03:33:31.487354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. (HTTP 404) (Request-ID: req-37132971-a479-485a-ba45-08e4eaf8ae33) Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.488252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 03:33:31.489428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 03:33:31.490581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2630b055-10b1-428f-b88c-e2b619e8f635 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Returning 404 to user: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2630b055-10b1-428f-b88c-e2b619e8f635 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 404 len: 109 microversion: 2.1 time: 0.086236 Nov 02 03:33:31.491689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:33:31 2022] DELETE /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:33:31.496462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-10bf5661-f530-4eb3-a1cf-cf6197dad742 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Calling method '.version_select at 0x7f5c931e00d0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:31.597713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-10bf5661-f530-4eb3-a1cf-cf6197dad742 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] HTTP exception thrown: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-10bf5661-f530-4eb3-a1cf-cf6197dad742 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Request method failure captured: Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd HTTP/1.1 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeT_z-QJjNIX9kKyiTCKgoo4gxbb5R5lPlLurUXnY54uXfeaOFRfDBjNSX9SqFSiTKW1byfelgocLxRA6PSF0LAryKj2DIknXAEpIhHOYq5y87gp9FtXDTVQV0vDVw9JwfZXa8rorcXMvnACzgE3FK_N2OMhAWxxzZwWK8d-VZY7LMI Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:33:31.600286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7961886d30c449aad4197024105a951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7961886d30c449aad4197024105a951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7961886d30c449aad4197024105a951"}]}] Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: d7961886d30c449aad4197024105a951 Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1121239603 Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: a820200be2114b1db5d350ead6625bf1 Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1121239603-project Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'c97c0dde-cce9-4f6e-ba0b-e7235e784bdd'} Nov 02 03:33:31.601808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. (HTTP 404) (Request-ID: req-d8c595a1-26f3-4428-ba97-89fb8b64b708) Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.602568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 03:33:31.603714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 03:33:31.604929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-10bf5661-f530-4eb3-a1cf-cf6197dad742 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] Returning 404 to user: Volume c97c0dde-cce9-4f6e-ba0b-e7235e784bdd could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-10bf5661-f530-4eb3-a1cf-cf6197dad742 tempest-VolumesSnapshotsTestJSON-1121239603 tempest-VolumesSnapshotsTestJSON-1121239603-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd" status: 404 len: 109 microversion: 2.1 time: 0.109901 Nov 02 03:33:31.606029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:33:31 2022] GET /compute/v2.1/os-volumes/c97c0dde-cce9-4f6e-ba0b-e7235e784bdd => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:33:33.909572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8b9d8328-98eb-438f-adbd-e2a04aa5f72e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'create', calling method: .version_select at 0x7f5c931a9430>, body: {"keypair": {"name": "tempest-keypair-1400785500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZxRBfk/PtOvbDybplDluGBkAmxf1Hfbc8o9egxln58Ew3NpSU7jRfuArGujgGlQ2O9GRK/HYFh2K7aj5F7E7zJ5YjDH8iJctxXlBQ1jdXaMS2WFhVErgaUJZ6eKdP13g=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:34.078759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-8b9d8328-98eb-438f-adbd-e2a04aa5f72e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for project d56f6d222a4d4411b8f4583c61f53129. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:34.115475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-8b9d8328-98eb-438f-adbd-e2a04aa5f72e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for user f16c6a2cd8594037ad47475ed1b3161c and project d56f6d222a4d4411b8f4583c61f53129. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:34.281164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8b9d8328-98eb-438f-adbd-e2a04aa5f72e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.657729 Nov 02 03:33:34.281776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 9/18] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Nov 2 03:33:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 659 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 03:33:40.769770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0879be19-a823-4cfe-9c68-ce516a5e6227 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: .version_select at 0x7f5c931e0670>, body: {"keypair": {"name": "tempest-keypair-533096675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEmlTcMEIug3yJn2SexSpamm3aPg/PRJpEOsABwAc100QJNFEMdytzuqDUSpylPB15olDRAinh4oJbAY90tTtx+uC1kGfTsGOMc11sgFaJP2HLwytgjQ2hVTuCNFDtEeA=="}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:40.831855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-0879be19-a823-4cfe-9c68-ce516a5e6227 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:40.846557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-0879be19-a823-4cfe-9c68-ce516a5e6227 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:40.972942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0879be19-a823-4cfe-9c68-ce516a5e6227 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.645806 Nov 02 03:33:40.973605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 10/19] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 03:33:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:42.248149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1759090078", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "networks": [{"uuid": "d8124fa5-e83b-491f-802a-c535a23284bf"}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:42.356659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1782949802", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "add58d78-bef4-428b-8ddb-f3f7aef42c6a"}], "security_groups": [{"name": "tempest-securitygroup--229328326"}], "key_name": "tempest-keypair-1400785500", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:42.551749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] validate_networks() for [('d8124fa5-e83b-491f-802a-c535a23284bf', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:43.914919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] validate_networks() for [('add58d78-bef4-428b-8ddb-f3f7aef42c6a', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:44.182702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=4 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:45.171762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:45.172597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:45.173635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:45.174484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:45.175241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:45.191019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:45.192320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:45.192965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:45.194599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:45.197134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:45.197980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:45.248323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Getting quotas for project f7ed6d39b2e343548a094be05af24877. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:45.260871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Getting quotas for user 7fdb70174b404f4abf0bc220d5dd4bb1 and project f7ed6d39b2e343548a094be05af24877. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:45.280604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:45.285844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:45.443836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eb669aef-b59a-4cf0-962a-80c8d7dd7b39 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.716559 Nov 02 03:33:45.444851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:33:46.216266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:46.222856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:46.222856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:46.222856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:46.222856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:46.245859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1515463838", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:46.261594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:46.268452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:46.269238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:46.273575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:46.274315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:46.275468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:46.342748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for project d56f6d222a4d4411b8f4583c61f53129. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:46.353887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for user f16c6a2cd8594037ad47475ed1b3161c and project d56f6d222a4d4411b8f4583c61f53129. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:46.378744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] validate_networks() for [('cc156427-69cf-4e80-8654-62824ea8d3a0', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:46.402093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:46.405725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:46.546629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3c8822f4-df9b-4a46-9c4b-aca56d95dc5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.195439 Nov 02 03:33:46.548842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 11/21] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Nov 2 03:33:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 4200 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 03:33:46.557509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1655305208", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e09a0e-4e79-4d08-a329-49c34bfe3e5f"}], "security_groups": [{"name": "tempest-securitygroup--1542413634"}], "key_name": "tempest-keypair-533096675", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:46.773887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] validate_networks() for [('d4e09a0e-4e79-4d08-a329-49c34bfe3e5f', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:47.395517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:47.396051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:47.396505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:47.397015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:47.397531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:47.428226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:47.430020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:47.430664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:47.431624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:47.432291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:47.432922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:47.506103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Getting quotas for project c3a4704c59a141a2a1abbb5abb65c994. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:47.540204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Getting quotas for user eed64456ec5c42b08df447e9a537c4d0 and project c3a4704c59a141a2a1abbb5abb65c994. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:47.627445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:47.636161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:47.636651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:47.637046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:47.637434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:47.637841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:47.641003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:47.659479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:47.659994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:47.660450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:47.661222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:47.661679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:47.668686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:47.744341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:47.753362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:47.767340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-263df0b8-3dd2-404a-a202-d375abe899db tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.320613 Nov 02 03:33:47.768657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:33:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:33:47.809850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:47.812863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:47.944359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-057a1577-e2e6-4cc0-a2c2-6e2773f7ea68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.390256 Nov 02 03:33:47.945930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 12/23] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:33:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:33:47.958852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:47.960291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:48.005896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:48.006387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:48.006827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:48.007536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:48.008005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:48.008734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:48.435461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-43ff56e9-d0d9-42ea-bd28-6540af934736 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'create', calling method: .version_select at 0x7f5c9306ee50>, body: {"keypair": {"name": "tempest-keypair-2101323682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7fDPqQT/xIZF2Vi3s5igA9/3osrroClPNQbyUvCVSM6EHkVbZSvj97fGzEPy0SzqZW9L/Xa6zcWx+5CkpvX1v1ofB6pHThkJAWSWW+nktnBZE8BcrXBdwktXTJLHJvUg=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:48.470809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:48.517836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-43ff56e9-d0d9-42ea-bd28-6540af934736 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:48.526817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fa11d778-3081-4e76-8c30-b260880fb00a tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1211 microversion: 2.1 time: 0.578887 Nov 02 03:33:48.527412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:47 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1211 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:48.536012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:48.541886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:48.544469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-43ff56e9-d0d9-42ea-bd28-6540af934736 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for user 18355f4225c9427dbb38fde84115d7b2 and project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:48.597512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:48.599335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:48.601829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:48.604469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:48.608342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:48.609781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:48.649925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-43ff56e9-d0d9-42ea-bd28-6540af934736 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.879959 Nov 02 03:33:48.659809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 12/25] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 03:33:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:33:48.664822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-003f1341-cd33-4064-bf78-83ddc8e85882 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:48.665445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-003f1341-cd33-4064-bf78-83ddc8e85882 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:49.490898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:49.521042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:49.535029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:49.556795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c258a406-28e7-4ab8-b049-06823fbad77f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1286 microversion: 2.20 time: 1.024376 Nov 02 03:33:49.581611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 14/26] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1286 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:33:49.589044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-003f1341-cd33-4064-bf78-83ddc8e85882 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:49.601836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:49.602469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:49.656554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-003f1341-cd33-4064-bf78-83ddc8e85882 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1222 microversion: 2.1 time: 0.969850 Nov 02 03:33:49.661449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:48 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1222 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:49.684793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:49.686052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:49.690631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:49.691652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:49.693281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:49.694787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:49.696654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:49.697875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:49.721421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:49.725131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:49.729978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:49.736707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:49.737812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:49.742156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:49.938712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:49.950845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-29c7b3e0-82c1-4d71-9f6f-83115a5b1e75 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1245 microversion: 2.1 time: 0.368010 Nov 02 03:33:49.958055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1245 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:50.063791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-836762189", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:50.146039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:50.195540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-591d4b79-4b12-4a60-8058-831eaac71698 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1275 microversion: 2.1 time: 0.531398 Nov 02 03:33:50.199531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:49 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1275 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:50.221659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] validate_networks() for [('cc156427-69cf-4e80-8654-62824ea8d3a0', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:50.590883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:50.592217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:50.604193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:50.619340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:50.621748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:50.625147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:50.629664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:50.632164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:51.048560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:51.058858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:51.066851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:51.068200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c581e00-b614-46dc-8ad0-102921970b83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1342 microversion: 2.20 time: 0.483172 Nov 02 03:33:51.080689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1342 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:33:51.095815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:51.101036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:51.114246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:51.119211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:51.120145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:51.121137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:51.121817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:51.122713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:51.349002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:51.362150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-170404b2-fa12-4c5e-8215-0710a8caf29b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1293 microversion: 2.1 time: 0.276670 Nov 02 03:33:51.365452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:51.381269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:51.387478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:51.416933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:51.419678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:51.420173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:51.423175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:51.439998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:51.444687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:51.711231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:51.725344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fb41ea9a-910c-41b7-bde9-2bd33f3ac532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1273 microversion: 2.1 time: 0.356288 Nov 02 03:33:51.726833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:51 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:52.105525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:52.110467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:52.144093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.145257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.145951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.146909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.147578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.148452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.375143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:52.395024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:52.405192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:52.407983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3c768279-f92f-4b20-a47c-5fdc7ac360e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1340 microversion: 2.20 time: 0.314890 Nov 02 03:33:52.410729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 18/33] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1340 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:33:52.434405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:52.436210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:52.463734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.464409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.466916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.471861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.473695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.476042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.648094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:52.648647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:52.649157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:52.650233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:52.650793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:52.670175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.676439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.676894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.677677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.678133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.678562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.696375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:52.706848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-02e97f3a-297c-41ab-98a6-a51651d6641a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1293 microversion: 2.1 time: 0.291666 Nov 02 03:33:52.707455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 19/34] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:52.712771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-936426324", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0f55973-8bdc-47ed-9a04-fee096583b88"}], "security_groups": [{"name": "tempest-securitygroup--513208239"}], "key_name": "tempest-keypair-2101323682", "user_data": "}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:33:52.726593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Getting quotas for project c3a4704c59a141a2a1abbb5abb65c994. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:52.731539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Getting quotas for user eed64456ec5c42b08df447e9a537c4d0 and project c3a4704c59a141a2a1abbb5abb65c994. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:52.759375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:52.764344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:52.901250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-79ee898e-89fc-4e5f-bf13-e6e6eb050be0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.842200 Nov 02 03:33:52.908894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 16/35] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:33:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 03:33:52.912932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:52.916889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:52.945264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.945762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.946204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:52.946914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:52.947369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:52.959999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:53.139721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] validate_networks() for [('d0f55973-8bdc-47ed-9a04-fee096583b88', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:33:53.533435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:53.543680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dcfb9784-24a9-4c72-a180-0c88f66627a1 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.639316 Nov 02 03:33:53.551559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 17/36] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:52 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:53.561193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f007eca9-99a4-4a1a-8b47-4330f5f37237 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:53.565227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f007eca9-99a4-4a1a-8b47-4330f5f37237 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:54.273185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f007eca9-99a4-4a1a-8b47-4330f5f37237 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:54.304893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f007eca9-99a4-4a1a-8b47-4330f5f37237 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1221 microversion: 2.1 time: 0.751962 Nov 02 03:33:54.309198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 18/37] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:53 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1221 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:54.324551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:54.326145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:54.346025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:54.349000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:54.351296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:54.353505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:54.354846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:54.356874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:54.721563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:54.743379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:54.747220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:54.749756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c0ef2d49-e1e9-444c-a905-ad9666898791 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1340 microversion: 2.20 time: 0.438021 Nov 02 03:33:54.752024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1340 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:33:54.759983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:54.764546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:54.770580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:54.771258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:54.772810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:54.773796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:54.775360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:54.778045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.336286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:55.346709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a9166f9-b283-44cd-ac5e-94a5c987eb5b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1301 microversion: 2.1 time: 0.592534 Nov 02 03:33:55.353254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1301 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:55.409713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:55.412890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:55.438303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.440684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.441324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.442208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.444665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.445102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.660126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:33:55.660635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:33:55.661232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:33:55.661754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:33:55.662235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:33:55.687256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.691654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.694234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.696451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.698569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.699352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.781656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:33:55.787508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for user 18355f4225c9427dbb38fde84115d7b2 and project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:33:55.810813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:33:55.816580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:33:55.915106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-08aa7c56-c421-4e3e-b1f7-196e796efb44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.206295 Nov 02 03:33:55.916178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:33:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:33:55.925355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:55.926318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:55.942289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.943135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.943828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:55.952418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:55.953170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:55.954353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:56.166571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:56.192473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-111dbd33-6b0f-4acc-9aec-3ead66cdc4e3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.836808 Nov 02 03:33:56.194566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:55 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:56.222306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:56.224317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:56.251701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:56.257272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:56.262027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:56.265170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:56.270000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:56.279639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:56.396507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:56.411889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c2c438a0-a061-4e5e-86aa-9e7bc78c2b34 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1217 microversion: 2.1 time: 0.492195 Nov 02 03:33:56.412789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:55 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1217 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:56.428421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a73de75f-c4f4-4ec9-9670-f390a9b9efb4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:56.429357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a73de75f-c4f4-4ec9-9670-f390a9b9efb4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:57.068600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.077166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.117735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.123539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dfe263ee-7f22-47d8-9082-2aaa982fe72d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.918725 Nov 02 03:33:57.148327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:33:57.155419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a73de75f-c4f4-4ec9-9670-f390a9b9efb4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.164746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:57.166422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:57.178968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.179908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.181014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.182057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.182791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.183361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.185564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a73de75f-c4f4-4ec9-9670-f390a9b9efb4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1237 microversion: 2.1 time: 0.766515 Nov 02 03:33:57.192910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 22/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1237 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:57.223049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:57.224323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:57.237438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.240606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.243204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.246275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.246961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.251218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.598293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.614007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0e704acf-2046-473e-859a-9869e518fb3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1299 microversion: 2.1 time: 0.458785 Nov 02 03:33:57.614614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1299 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:57.649431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:57.652084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:57.661378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.668625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.669806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.672451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.677613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:57.677943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-46538a54-62cd-40cc-a3b0-aa9f89eec532 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.453711 Nov 02 03:33:57.678835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:57.679101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 23/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:57 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:57.679821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:57.928945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:57.940758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-07b00da0-d1bb-4a37-a397-0f19d7a64d7e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.302229 Nov 02 03:33:57.955472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 24/47] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:57 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:58.159513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:58.160905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:58.169425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:58.174479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.175287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.177494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.178478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.182453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.183134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.216618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:58.217316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:58.226549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.227047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.227479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.228211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.228662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.229084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.515254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:58.534760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9672a31a-deda-4233-a292-5a978e8b40bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.315759 Nov 02 03:33:58.548585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:58.645670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:58.647233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:58.658524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.659215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.660599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.661463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.663584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.664201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.889357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:58.902848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:58.905750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3966d7ac-4cf0-4b94-8bc7-8ea288b376c4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1299 microversion: 2.1 time: 0.264969 Nov 02 03:33:58.906757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 26/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:33:58.923482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:58.925040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:58.926340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1f8006f3-f00c-46c7-ae4a-8440a131d790 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.771554 Nov 02 03:33:58.926906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 24/50] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:33:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:33:58.946554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:58.947673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:58.961240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.964539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.968088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.968862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:58.969555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:58.970651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.971127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.975162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.976446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.977107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.977703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:58.978547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:58.979170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:58.979733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:59.171523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:59.191607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58621c5e-083b-4310-a39b-33f8a6ee8509 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.230707 Nov 02 03:33:59.192224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:58 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:59.482965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:59.500294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-032179e0-27b7-41b6-bd98-070b784b09ae tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.582274 Nov 02 03:33:59.501462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:58 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:59.577736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:59.581634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:59.591640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:59.592444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:59.593050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:59.593929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:59.595764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:59.596504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:59.717124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:33:59.734868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-36bea7aa-bb9f-47d8-99cf-8b6849f3a2ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.165846 Nov 02 03:33:59.737364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 26/53] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:33:59.935775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:33:59.936716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:33:59.944237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:59.945318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:59.945987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:59.946747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:33:59.947333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:33:59.948065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:33:59.973530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d35187a7-e849-45e4-ba14-42a1e6e0c371", "tag": "a0f307cd-33a5-43c2-b214-ffc61e4ce9d8"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:00.000933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.003188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.003624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.030388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Creating event network-changed:a0f307cd-33a5-43c2-b214-ffc61e4ce9d8 for instance d35187a7-e849-45e4-ba14-42a1e6e0c371 on hv-cinder-86020 Nov 02 03:34:00.031535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125411) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 03:34:00.032211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-e49d101b-267a-478b-aac0-f03776f1c9ff req-606d8c73-4286-4826-ab61-32a9d09bf966 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125411) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 03:34:00.033397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.034189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.034925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.035743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.036225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.036910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.046043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.compute.rpcapi [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 03:34:00.047384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] Releasing lock "compute-rpcapi-router" {{(pid=125411) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 03:34:00.073800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9cadfe02-ae60-4375-b9b9-839ec600638f None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187864 Nov 02 03:34:00.074184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:00.085340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:00.087311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:00.095009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.096114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.098519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.099208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.103643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.103643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.165043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.173008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d05622f0-76bf-498d-a6d3-c094ad5403b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.244997 Nov 02 03:34:00.188936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 27/55] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:33:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:00.362846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.364275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:00.372875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.374839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.376692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f5dbe9e2-8837-47ae-8d4d-14c7805d3332 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.300899 Nov 02 03:34:00.377365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.377837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.377990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 29/56] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:00.378549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.382943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:00.383623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:00.389062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:00.400554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.401044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.401757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.402845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.403306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.403800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.412830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Creating event network-changed:1d12b4d0-54ad-447a-8d59-df5c58c000f7 for instance a5773140-5308-4eaf-8557-2d9739c592ea on hv-cinder-86020 Nov 02 03:34:00.413590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 03:34:00.418050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c0f5b9c3-bfcf-4ef7-ab75-3e325ba3be2a req-ba2d8d46-ebc4-4e71-b4ef-b9a2644030c1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 03:34:00.419632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.420374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.420967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.421834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.422432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.423622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.445151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.compute.rpcapi [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 03:34:00.446244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] Releasing lock "compute-rpcapi-router" {{(pid=125410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 03:34:00.477537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-edb5e66c-5099-4ed8-8239-f94c93e93e9f None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286902 Nov 02 03:34:00.479264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 28/57] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:00.484698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.489236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:00.494342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c7afac1a-189e-4456-ab13-18e7762bb4d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.115439 Nov 02 03:34:00.495504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:00 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:00.530784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:00.532476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:00.538723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.539210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.539640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.540549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.541142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.541721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.698683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.706872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-808a45fe-2732-4474-ad21-569e030131a4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.180178 Nov 02 03:34:00.707866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:00 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:00.761546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:00.762629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:00.774734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.775538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.776227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.777665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:00.778522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:00.779145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:00.870368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:00.881544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f5f6ae98-1013-4d4e-bbee-1d412f66f125 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.125701 Nov 02 03:34:00.895699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 31/60] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:01.199261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:01.199844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:01.206104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.206642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.207074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.207827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.208457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.208944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.381464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.402911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-45600052-06f5-4ff2-9fae-fc1504966791 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.207797 Nov 02 03:34:01.405420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 30/61] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:01.407077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:01.407725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:01.414665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.415297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.415739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.416459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.417106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.417491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.546703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:01.547333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:01.567010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.567511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.567972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.568691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.580305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.581335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.692087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.696627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:01.705232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0a5d3611-916b-4963-a19c-c025b062741f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.189704 Nov 02 03:34:01.706396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 31/62] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:01 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:01.737155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:01.738079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:01.745315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.746145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.746786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.747967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.748615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.749219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.764292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.776281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.780480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.781644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ae739d90-ad65-4981-9807-92dd12d403ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.378550 Nov 02 03:34:01.785390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 32/63] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:01.909757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:01.910467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:01.926218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.928533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.928977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.929689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:01.930142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:01.930588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:01.958594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:01.975048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce9a1697-e2b3-44d1-988a-80b35cb19bd5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.245263 Nov 02 03:34:01.975814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:01 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:02.064429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:02.072999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bd8b2b9a-4848-4c4e-a890-1be50406e193 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.170055 Nov 02 03:34:02.073819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:02.432632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:02.433231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:02.439841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.440349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.440784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.441471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.441914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.442332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.645708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:02.653655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-55fc58e3-75e5-479f-8ff9-bd723e391b95 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.225253 Nov 02 03:34:02.655821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:02.743642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:02.744188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:02.750465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.751002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.751430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.752152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.752603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.753063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.808712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:02.809827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:02.820085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.824703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.825905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.826684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:02.827201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:02.827648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:02.859704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:02.871834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c27389a4-de63-4479-acd4-47aab5451581 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.131767 Nov 02 03:34:02.890438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:02 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:03.006695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:03.007907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:03.015306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.016064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.016792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.017893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.018788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.019442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.037846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.048981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.050450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.051552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5fde4b11-3558-47c2-8489-1ce814152836 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.247152 Nov 02 03:34:03.052124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:03.098099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:03.099041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:03.105803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.106824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.107456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.108196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.108795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.109184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.233120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.269067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-45e0dd8d-8736-431d-9725-f8d6748b198a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.166487 Nov 02 03:34:03.274726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:03.292050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.303082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-626c707f-6866-4300-99eb-41a2807ab347 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.300961 Nov 02 03:34:03.306993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 35/70] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:03 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:03.679143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:03.679993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:03.688216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.688216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.688474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.689424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.690062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.690710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.871483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:03.880720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c6fb2c2-c805-4d86-80d3-b8bab74c8c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.205448 Nov 02 03:34:03.897645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:03.899438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:03.900673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 36/71] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:03.905758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.906278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.907294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:03.908023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:03.908627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:03.909236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.010499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.021125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9a16b71d-cdd6-4c92-aabb-270b91e4b78f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.127630 Nov 02 03:34:04.021926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 36/72] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:03 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:04.076577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:04.077089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:04.089960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.090748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.091382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.092347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.092983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.093600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.276286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.285258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.286686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.287993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e4906ea8-63c8-4a5c-8b52-f25bb8493192 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.215432 Nov 02 03:34:04.288521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 37/73] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:04.307087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:04.308199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:04.310152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=24 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:04.316278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.317023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.317464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.318170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.318621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.319044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.338610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:04.339213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:04.345647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.346120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.346546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.347223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.347667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.348246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.381630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.394101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eb4935c1-24ad-4967-8fe6-4c08b1f3a6d2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.086473 Nov 02 03:34:04.394101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 37/74] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:04.487820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:04.495746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-54ee5704-a9f6-4d22-a4c3-2807279e2976 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.160914 Nov 02 03:34:04.496398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 38/75] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:04 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:04.907420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:04.908090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:04.914094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.914577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.915012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:04.915698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:04.916179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:04.916605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.048815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:05.049762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:05.056170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.056726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.057240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.058037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.059030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.059564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.061828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.069465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-98f40268-7fbd-46be-891f-9e43a33e19c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.166395 Nov 02 03:34:05.070029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 38/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:05.122563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.131026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-57d037c9-5537-4273-97ed-1328c1128e5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.086645 Nov 02 03:34:05.131588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 39/77] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:05 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:05.312823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:05.313947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:05.322150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.322649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.323081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.323771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.324239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.324666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.418503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:05.419217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:05.425453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.426006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.426512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.427295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.427814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.428324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.473612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.482429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.483881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.485068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0eba3a65-79fe-4188-92bf-883e5163e342 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.176094 Nov 02 03:34:05.492219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 39/78] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:05.505708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.514569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-44c0f2d3-9f94-4127-ad08-7da96a367131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.100457 Nov 02 03:34:05.515138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 40/79] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:05.519767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:05.520511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:05.527898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.528807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.529463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.530812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:05.531473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:05.532153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:05.672072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:05.680210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6241b1bf-5b5a-4ca3-980f-37d74bbd5d5c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.165604 Nov 02 03:34:05.680773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 40/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:05 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:06.092869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:06.093610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:06.100555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.101040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.101475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.102173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.102621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.103041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.154149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:06.155733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:06.164033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.164863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.166093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.166838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.167304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.167732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.248414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.257628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-61f143df-8884-45a9-8aab-1f9679885559 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.107257 Nov 02 03:34:06.271974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 41/81] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:06 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:06.277743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.287214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c9162b4-852f-42c6-9f28-46a70ca078e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.198230 Nov 02 03:34:06.287881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 41/82] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:06.510461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:06.511064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:06.517479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.517949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.518401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.519071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.519515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.519927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.545294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:06.545718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:06.552197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.552691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.553124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.553880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.554369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.554695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.635826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.644180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b00cde9e-690f-4299-bc35-0c1c680e283c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1241 microversion: 2.1 time: 0.105285 Nov 02 03:34:06.644746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 42/83] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:06.695423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.702666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:06.706221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:06.706418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.707235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.708405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8961ff41-82f6-4844-8975-9fcd5ce083a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.201757 Nov 02 03:34:06.709324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 42/84] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:06.723256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.723256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.723256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.723256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:06.723871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:06.725110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:06.861726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:06.874642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6ab63dea-566a-4fc7-8fe7-224f129f80eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.175756 Nov 02 03:34:06.875327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 43/85] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:06 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:07.280716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:07.281468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:07.287524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.288025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.288550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.289137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.289589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.290001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.310305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:07.310915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:07.312792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=26 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:07.324542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.331042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.336381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.340379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.340874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.341330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.354126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:07.362632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1d2646e7-8528-44fa-94e3-5f5aabce5ff5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1273 microversion: 2.1 time: 0.085689 Nov 02 03:34:07.363451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 43/86] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:07 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:07.492351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:07.549188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dcb6bd24-29a7-420e-8f24-b8ba5f2580b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.240987 Nov 02 03:34:07.551707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 44/87] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:07.668695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:07.669730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:07.682696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.684937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.688866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.689848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.691289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.694559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.734161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:07.736393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:07.744033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.744724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.745225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.746137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:07.746653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:07.747157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:07.975859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:07.997985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-57a3ad7a-fb83-48ee-8d4f-9b3932725e29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1233 microversion: 2.1 time: 0.333295 Nov 02 03:34:07.999156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 44/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1233 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:08.010329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:08.011839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:08.029540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.030239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.031242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.032517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.033168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.033772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.208492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:08.223107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:08.224858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:08.226280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-59423972-e0eb-448e-b556-714597b5d90f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.496264 Nov 02 03:34:08.227624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 45/89] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:08.387489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:08.389030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:08.396295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.397085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.397755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.398714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.399245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.399892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.613446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:08.623195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b3454c81-bd18-49b1-ad4a-ed6b3e8f29c5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1279 microversion: 2.1 time: 0.240316 Nov 02 03:34:08.624423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 46/90] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:08 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:08.629298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:08.630415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:08.636368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.636850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.637330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.638122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:08.639318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:08.639832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:08.833164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:08.840888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-396c1bca-6c0d-495d-a415-19a45176f08c tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.840522 Nov 02 03:34:08.856346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:07 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:09.031166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:09.031934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:09.052234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.055471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.055471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.055471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.055471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.056309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.208600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.241475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-baacfa80-d3b7-4545-aa18-b3cd1ecc925a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1295 microversion: 2.1 time: 0.217161 Nov 02 03:34:09.242406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1295 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:09.272292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:09.273698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:09.283666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.284501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.284952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.285655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.286849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.287503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.289717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.294176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8bf1859c-9edd-4012-b9e6-436f0ade6753 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.668552 Nov 02 03:34:09.294771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 47/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:09.333830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:09.647538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:09.648300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:09.657668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.658193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.658637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.665200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.666056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.666727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.701806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:09.874900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.883623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-03279b14-587c-4224-8816-f301b77a6fbc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1279 microversion: 2.1 time: 0.240152 Nov 02 03:34:09.885609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 48/94] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:09 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:09.900104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.909159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9436aec2-8b2e-443f-a1c7-21a459f4bafa", "tag": "1f57d818-7578-4909-88a4-e3f00ada7d97"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:09.909842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.911543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:09.912874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dfb5bbee-9faf-49f8-b31d-84303b8747d3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.645425 Nov 02 03:34:09.913964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 47/95] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:09.918685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:09.920567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:09.926731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.927500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.932984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.935087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.937223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.939128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.951915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:09.952896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:09.956398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:09.986917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] Creating event network-changed:1f57d818-7578-4909-88a4-e3f00ada7d97 for instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa on hv-cinder-86020 Nov 02 03:34:09.992478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-c525df30-982d-472b-99b7-41f117365e63 req-80774693-66e0-42c5-b4ec-c22df36c9d08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105245 Nov 02 03:34:09.993310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 49/96] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:10.043944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=8 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:10.274080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:10.275801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:10.284890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.286495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.287388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.288401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.290128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.290555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.384797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:10.392381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-773691ab-df01-4754-9ef8-be0e376f0b51 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.477199 Nov 02 03:34:10.394192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 48/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:09 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:10.406330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:10.406961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:10.420309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.422051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.423199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.432797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:10.448818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=8 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:10.449799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.450282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.450728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.455239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-29e8a80d-f074-45c8-be20-139ba448b6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1295 microversion: 2.1 time: 0.183733 Nov 02 03:34:10.469004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 50/98] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1295 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:10.914687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:10.917381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:10.923586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:10.931715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.932565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.933311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.935145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.935896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.937293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.949873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f2973fa8-8fb3-4031-a476-c9d75b019237 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.552991 Nov 02 03:34:10.952104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:10.967424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:10.968246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:10.979020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.986457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.987148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:10.988063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:10.988658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:10.989222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:11.258360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.268403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.271325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.275869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.283019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aeb65873-618e-47cc-a901-496e95c7af4d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.331058 Nov 02 03:34:11.285458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a692e2e4-8ba8-4dc8-b266-93597796a271 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.382540 Nov 02 03:34:11.286297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 50/100] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:11.302343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:10 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:11.423115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:11.426571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:11.442562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:11.443060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:11.443492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:11.446015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:11.447463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:11.448995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:11.482021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:11.482932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:11.493951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:11.494673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:11.495219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:11.496194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:11.496877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:11.498446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:11.680907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.695830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2abd86f6-dd14-4163-bc4d-ceb66900e14f tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.283271 Nov 02 03:34:11.696654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 51/102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:11 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:11.713350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:11.723866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6dd06aa3-3a6e-4171-82c0-565e44706154 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.246619 Nov 02 03:34:11.724787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 52/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:12.001237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:12.004739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:12.020712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.023134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.039922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.043802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.044939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.045640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.060703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be47a8e9-ddac-4b17-bbc7-11128bfcf574", "tag": "a925dca0-bdfe-47a7-ac43-6e8cccf35cf9"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:12.088167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.088657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.091696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.125963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] Creating event network-changed:a925dca0-bdfe-47a7-ac43-6e8cccf35cf9 for instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 on hv-cinder-86020 Nov 02 03:34:12.130905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-5c84d2c3-c236-4b3e-a2cf-26f67110de7f req-ae4fd926-0b54-4e19-b316-a8f340682546 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074834 Nov 02 03:34:12.131504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 53/104] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:12.309356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:12.315200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:12.315981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:12.324178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cf082158-9f13-4b7b-95b5-a254a2e3e64e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.333240 Nov 02 03:34:12.324417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.324684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.325349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.326229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.326348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 52/105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:12.326950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.327529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.341595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:12.342658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:12.349851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.350594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.351184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.352440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.353044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.353606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.588667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:12.598072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c529a84c-4566-4d3f-8de2-b20c4e78fbe2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.287896 Nov 02 03:34:12.599014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 54/106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:12 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:12.616525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:12.626753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:12.628646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:12.629674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-df61c3e0-0290-47d5-8754-212eec7c5814 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.302314 Nov 02 03:34:12.644422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 53/107] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:12.722272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:12.723076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:12.729761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.730346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.730904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.731875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.732447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.732986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.750843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:12.751730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:12.764130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.764542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.764976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:12.766566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:12.767251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:12.767671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.159579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.207693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93e4580f-00f6-4869-8ab8-98c65343cc11 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.489793 Nov 02 03:34:13.208630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 55/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:12 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:13.224552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.234314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2229cfe9-758e-4fdd-8eb1-918af6b65f6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.486677 Nov 02 03:34:13.235518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 54/109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:13.352791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:13.353641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:13.360013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.361145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.361765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.362733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.363191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.363620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.537525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.550057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-419298e7-ea54-4a5a-9271-f4739349870b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.200920 Nov 02 03:34:13.550846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 56/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:13.622051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:13.623166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:13.629564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.630693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.631287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.632773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.634041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.634439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.657207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:13.658261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:13.665855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.666511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.667098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.668277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:13.668941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:13.669638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:13.884285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.891702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.894288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67552d16-c2d6-40bb-ab7a-545bf47d76fb tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.275608 Nov 02 03:34:13.896041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 55/111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:13 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:13.901320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.902775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:13.903871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dfff184c-6000-468e-a60e-5a87410ef4bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.252460 Nov 02 03:34:13.916278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 57/112] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:14.179902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68620f31-6b17-41c5-9c0f-48ac66097f04", "tag": "eb29890c-297b-42ed-a158-d316f359bc7c"}, {"name": "network-changed", "server_uuid": "1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0", "tag": "4c97f3b3-e1ee-4b0e-b586-9bac85860da9"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:14.194417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.195752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.196413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.212406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Creating event network-changed:eb29890c-297b-42ed-a158-d316f359bc7c for instance 68620f31-6b17-41c5-9c0f-48ac66097f04 on hv-cinder-86020 Nov 02 03:34:14.213433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] Creating event network-changed:4c97f3b3-e1ee-4b0e-b586-9bac85860da9 for instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 on hv-cinder-86020 Nov 02 03:34:14.220791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-3862fedb-1e26-44e7-90d5-f61648d91e45 req-fcbf5872-f776-4ad0-81e3-8eb2be00c3ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044893 Nov 02 03:34:14.221564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 56/113] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:14.234296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:14.236166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:14.246237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.246971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.247581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.248711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.249569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.251648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.259036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:14.260323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:14.270173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.270817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.271393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.272267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.272710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.273286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.520143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:14.524102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:14.532963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eaedcc78-f59e-4157-b459-7a7779bdf6b4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.301744 Nov 02 03:34:14.533192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce6e40be-64e8-4ab5-987a-0fd69002f841 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.278419 Nov 02 03:34:14.545969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 58/114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:14 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:14.547998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 57/115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:14.579309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:14.579936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:14.586897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.587392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.587831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.588594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.589047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.589474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.760297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:14.769219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4ef6bd23-94dc-43d8-af3a-13e0b91a9249 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.194312 Nov 02 03:34:14.769845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 59/116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:14.918348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:14.918961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:14.925395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.926131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.926566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.927261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.927704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.928154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.930844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:14.931467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:14.939965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.940748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.941935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:14.942891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:14.944376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:14.944816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.135884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:15.149861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-402cf71d-a2a3-4822-8064-34fe254a2b8b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.234755 Nov 02 03:34:15.150867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 58/117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:14 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:15.159534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:15.188645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:15.190117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:15.191269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93205ec2-5ae7-4224-973c-36cc26dfddc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.264593 Nov 02 03:34:15.191835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 60/118] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:14 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:15.556643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:15.557256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:15.558207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:15.561835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:15.565737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.568567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.574661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.575464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.576426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.577238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.577818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.577971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.578906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.579630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.581037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.581621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.838362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:15.849530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-83e48536-7fee-4f6c-b3e5-5d617d5172c6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.295805 Nov 02 03:34:15.850889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 59/119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:15.858173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:15.860134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:15.867356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.868772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.869530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:15.870506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:15.871196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:15.871783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.004293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.023323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-62608f5e-6923-4e63-b094-b5bc307dfdb8 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.470057 Nov 02 03:34:16.024347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 61/120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:15 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:16.175351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:16.176941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:16.198538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.199040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.199472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.200411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.201010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.201645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.422316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.430330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b882fb3c-abee-45e4-8503-6f13f40bd7be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.578094 Nov 02 03:34:16.430905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 60/121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:16.443683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:16.444401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:16.453994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.454938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.455383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.456129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.456589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.457010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.506938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.522244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-78769cee-e222-494e-9970-6c123d706180 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.352173 Nov 02 03:34:16.535980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 62/122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:16 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:16.628156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.636976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.638614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:16.639778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2ac68420-8372-45cb-b47a-0e7716ca086c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.207401 Nov 02 03:34:16.640415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 61/123] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:16.875973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:16.876606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:16.882548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.883030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.883468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:16.884181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:16.884635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:16.885056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.012816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.020831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bdd054f6-0779-4519-a31e-ddff0239f900 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.149595 Nov 02 03:34:17.021388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 63/124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:17.046341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:17.047117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:17.054214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.054877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.055415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.056256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.056908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.057420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.188152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.195679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-627400db-1482-4065-98f6-bab229c2a29b tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.153265 Nov 02 03:34:17.196270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 62/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:17 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:17.453274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:17.454591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:17.460534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.461020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.461455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.462148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.462617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.463041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.568692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:17.570259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:17.600225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.600225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.600225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.600225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.600578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.600578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.603301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.620245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fb691ef0-63be-45f4-8184-3eac75e619bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.170727 Nov 02 03:34:17.620806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 64/126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:17.668412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:17.669626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:17.678486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.679610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.680296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.681417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.682159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.684354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.870772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.884379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-07be4d46-2469-430a-a886-380b92cf34bd tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.339866 Nov 02 03:34:17.900396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 63/127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:17 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:17.920455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.929838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.931602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:17.932921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-100fb7ab-404f-4aac-8a42-f2d4ba09f313 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.271476 Nov 02 03:34:17.934154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 65/128] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:17.975419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "name": "network-vif-plugged", "status": "completed", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:17.985437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:17.986146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:17.986560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:17.998250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] Creating event network-vif-plugged:1d12b4d0-54ad-447a-8d59-df5c58c000f7 for instance a5773140-5308-4eaf-8557-2d9739c592ea on hv-cinder-86020 Nov 02 03:34:18.003471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-bf61bb88-1e91-469c-9dbc-6a2e2a16b82d req-9ec07eb6-50a2-4981-8075-b6d21718e1d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101650 Nov 02 03:34:18.004235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 64/129] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:18.046351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:18.046977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:18.056076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.056618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.057065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.072354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.074763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.076492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.099142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:18.219028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:18.220403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:18.232567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.233720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.235177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.236234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.239012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.239621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.290087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:18.311042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:18.322656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18158bc5-632f-472d-be50-75b121dc82cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.281146 Nov 02 03:34:18.323243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 66/130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:18.486295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:18.494734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f25f5aca-5aa5-4104-ba28-142816893d28 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.280263 Nov 02 03:34:18.495306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 65/131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:18 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:18.645209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:18.645937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:18.652562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.653048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.653514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.654489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.655151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.655841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.788115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:18.795795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-089f0c3e-a6c8-4cb3-bbb5-b1a65a24c2a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.155099 Nov 02 03:34:18.796415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 67/132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:18.907174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:18.907817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:18.913760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.914243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.914682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.915366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.915822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.916275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.958452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:18.959159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:18.965817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.966373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.966814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:18.967539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:18.968014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:18.968439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.120860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.128648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2d3d0e9b-4834-4863-b2a8-7b8e72d96be9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.225889 Nov 02 03:34:19.129204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:18 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:19.146006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.154240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.155685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.157354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e9e16e5-ea80-4fd6-b8f9-92b74aefa4a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.202857 Nov 02 03:34:19.157906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 68/134] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:19.347113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:19.347738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:19.355329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.355826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.357359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.357359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.357536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.358016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.519003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:19.519775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:19.550614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.553092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.553679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.555161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.556501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.557115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.584632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.597026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ff776ac-758f-4dc1-acd4-4bb18c82d5e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.255261 Nov 02 03:34:19.598860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:19.772961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.787776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ac9bd93-63ed-4a21-ab73-ea1627cc5329 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.271921 Nov 02 03:34:19.789244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 69/136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:19 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:19.818637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:19.819428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:19.826170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.826807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.827384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.828264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:19.828917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:19.829656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:19.990183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:19.999089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-54a962db-d20e-4e3a-9195-c8160791967b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.184284 Nov 02 03:34:20.006157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:20.025859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d35187a7-e849-45e4-ba14-42a1e6e0c371", "name": "network-vif-plugged", "status": "completed", "tag": "a0f307cd-33a5-43c2-b214-ffc61e4ce9d8"}, {"server_uuid": "9436aec2-8b2e-443f-a1c7-21a459f4bafa", "name": "network-vif-plugged", "status": "completed", "tag": "1f57d818-7578-4909-88a4-e3f00ada7d97"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:20.038313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.038868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.039309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.055740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Creating event network-vif-plugged:a0f307cd-33a5-43c2-b214-ffc61e4ce9d8 for instance d35187a7-e849-45e4-ba14-42a1e6e0c371 on hv-cinder-86020 Nov 02 03:34:20.056682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] Creating event network-vif-plugged:1f57d818-7578-4909-88a4-e3f00ada7d97 for instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa on hv-cinder-86020 Nov 02 03:34:20.065522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-3066e5a4-f8ef-4d13-91e5-d2ce1e097aeb req-d392e655-bf7d-475a-9cc8-f65abf8f4cff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043251 Nov 02 03:34:20.066477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 70/138] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:20.150447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:20.151059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:20.157668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.158345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.158783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.159487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.160161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.160769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.184930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:20.186096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:20.196279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.197467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.198726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.199871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.200555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.201072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.372174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.382201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-10d263eb-9bbd-4cfd-9634-2f2636a026dc tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.235429 Nov 02 03:34:20.382901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 69/139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:20 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:20.433045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.444945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.446735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.447468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3af8a1ce-6c25-4783-8cf5-ac21d529e6cd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1407 microversion: 2.20 time: 0.269215 Nov 02 03:34:20.451837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 71/140] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:34:20.621668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:20.622288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:20.629512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.630005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.630442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.631340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.632602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.632958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.810512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.811642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:20.812517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:20.818799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9035a1d-c527-4536-a309-d66ff282a266 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.201164 Nov 02 03:34:20.819370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:20.819705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.820541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.820961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.821670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:20.822340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:20.822789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:20.988322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:20.996811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b3c37821-983c-4cf7-a834-c770d12eb03d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.189891 Nov 02 03:34:20.997512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 72/142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:20 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:21.022452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:21.023105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:21.029123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.029788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.030416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.031273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.031932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.032523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.251096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:21.267058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9a2c46ef-01d3-4e2f-9d6f-9767b937b2db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.247531 Nov 02 03:34:21.269649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 71/143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:21.407819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:21.409408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:21.417106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.417844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.418915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.419917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.420532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.421099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.476457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:21.477149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:21.483645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.484227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.484916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.485699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.486211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.486703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.661323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:21.669445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ef95b1c8-e5f3-4146-bea3-a3ced54c20d1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.268238 Nov 02 03:34:21.670261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 73/144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:21 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:21.698404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:21.708637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:21.710324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:21.711931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1500339f-4167-4ec1-a10a-d7aff662f5af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1599 microversion: 2.20 time: 0.239256 Nov 02 03:34:21.712653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 72/145] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:34:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1599 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:34:21.738585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:21.739082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:21.743192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:21.747239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.747765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.748481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.749174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.749624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.750042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.841576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:21.842523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:21.849119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.849837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.850458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.851348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:21.851805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:21.852249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:21.876124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b94382cc-0d5f-4346-a75e-87581f864f9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141197 Nov 02 03:34:21.876664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 74/146] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Nov 2 03:34:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:34:22.020349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:22.021467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:22.027585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.028587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.029239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.030031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.030683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.031305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.214454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:22.225682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f146938b-eeb1-4303-a699-fefa17d0d28d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.387565 Nov 02 03:34:22.226503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 73/147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:22.290698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:22.291309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:22.297486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.298005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.298437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.299131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.299581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.300028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.383377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:22.391606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9d168e8e-a239-4101-a549-d4dbc0f90a29 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.375544 Nov 02 03:34:22.392322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 75/148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:22 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:22.694618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:22.695234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:22.701673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.702163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.702836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.704116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:22.704803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:22.705300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:22.807634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:22.825985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e8d4cc5-a99c-4354-90d1-0a80f7a9efd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1367 microversion: 2.1 time: 0.533915 Nov 02 03:34:22.826780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 74/149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:23.064863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:23.072813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae9a319a-0a3f-4f88-886e-cae6adabf264 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.383407 Nov 02 03:34:23.073505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 76/150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:22 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:23.252832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:23.253668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:23.259761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.260354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.260858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.261689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.262182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.262682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.415694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:23.416345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:23.425635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.426127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.426789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.428403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.428867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.429432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.580997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:23.589498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-82aed982-ff3c-4ad2-8eb9-ce8b5c093734 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.340571 Nov 02 03:34:23.590633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 75/151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:23.631681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0", "name": "network-vif-plugged", "status": "completed", "tag": "4c97f3b3-e1ee-4b0e-b586-9bac85860da9"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:23.647456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.648312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.648965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.668345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] Creating event network-vif-plugged:4c97f3b3-e1ee-4b0e-b586-9bac85860da9 for instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 on hv-cinder-86020 Nov 02 03:34:23.675394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-28481b23-f4f5-4413-9acf-6a0a0d648dab req-29963418-b4e0-464f-84ff-82aba414b8ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047601 Nov 02 03:34:23.676593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 76/152] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:23.746492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:23.757995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1a4564b7-38b2-4063-87a0-6f10eb223602 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1315 microversion: 2.1 time: 0.346374 Nov 02 03:34:23.758851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 77/153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:23 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:23.851384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:23.852360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:23.863348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.863813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.869609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:23.876362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.880359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.882864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.883247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.892289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:23.892996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:23.893583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:23.932481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] Creating event network-changed:1d12b4d0-54ad-447a-8d59-df5c58c000f7 for instance a5773140-5308-4eaf-8557-2d9739c592ea on hv-cinder-86020 Nov 02 03:34:23.942450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-35878aab-3e16-4f82-a026-d0c4468ba550 req-dbb71994-281a-4d25-bc76-ed4c856aebb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076233 Nov 02 03:34:23.945952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 78/154] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:24.052224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:24.082327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-866be375-2dd3-4dba-bd7b-870e70d5877c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1556 microversion: 2.1 time: 0.234978 Nov 02 03:34:24.084557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 77/155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:24.100264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:24.101069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:24.119808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:24.120348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:24.136510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.137020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.137465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.138183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.138649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.139077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.175670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.177463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.182051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.186969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.187465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.192199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.441954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:24.453281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8eb4ed1e-c8f8-4aa4-aa6e-8304eab29053 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.360558 Nov 02 03:34:24.456169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 79/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:24 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:24.528353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-75de0bc5-ed1a-4485-aaae-f8ca9d28a8a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.420061 Nov 02 03:34:24.536098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 78/157] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 03:34:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-interface => generated 284 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:24.614825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:24.615697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:24.624334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.625007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.625633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.626517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.627142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.627736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.786345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:24.786978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:24.798187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.798682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.799118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:24.799824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:24.800330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:24.800757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:25.190014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:25.199290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-001ff505-92f8-4b0f-b692-a5e0d4643e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.588403 Nov 02 03:34:25.199977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 80/158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:25.340700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:25.348615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68b64eb1-ba42-44f3-99fc-79d8bb450ff6 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1502 microversion: 2.1 time: 0.566440 Nov 02 03:34:25.349190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 79/159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:24 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1502 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:25.478600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:25.479658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:25.491145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:25.491763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:25.492309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:25.493045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:25.493497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:25.493920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:25.745882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be47a8e9-ddac-4b17-bbc7-11128bfcf574", "name": "network-vif-plugged", "status": "completed", "tag": "a925dca0-bdfe-47a7-ac43-6e8cccf35cf9"}, {"server_uuid": "68620f31-6b17-41c5-9c0f-48ac66097f04", "name": "network-vif-plugged", "status": "completed", "tag": "eb29890c-297b-42ed-a158-d316f359bc7c"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:25.757975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:25.769668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:25.773269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:25.773924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:25.830137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Creating event network-vif-plugged:a925dca0-bdfe-47a7-ac43-6e8cccf35cf9 for instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 on hv-cinder-86020 Nov 02 03:34:25.832321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] Creating event network-vif-plugged:eb29890c-297b-42ed-a158-d316f359bc7c for instance 68620f31-6b17-41c5-9c0f-48ac66097f04 on hv-cinder-86020 Nov 02 03:34:25.846702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-072be508-4f02-46d7-93bc-8eee18097cdd req-afad88ef-243d-47e0-b9ca-7fb5f77f6c57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104390 Nov 02 03:34:25.851048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 80/160] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:25.932936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:25.942216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-56a8708c-300d-485b-a6e4-f9fdb47dfa5b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1321 microversion: 2.1 time: 0.468066 Nov 02 03:34:25.942801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 81/161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:25 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:26.223894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:26.224622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:26.235522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.236038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.237109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.239069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.239522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.239941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.460326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9436aec2-8b2e-443f-a1c7-21a459f4bafa", "tag": "1f57d818-7578-4909-88a4-e3f00ada7d97"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:26.476792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.477271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.477694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.481062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:26.491773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4e662033-b096-4733-bc90-123d86ef2f6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.272071 Nov 02 03:34:26.493642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:26.494700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] Creating event network-changed:1f57d818-7578-4909-88a4-e3f00ada7d97 for instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa on hv-cinder-86020 Nov 02 03:34:26.510921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-76a6476a-ced3-4d22-82fe-0dc702d1dd18 req-db162ff8-c3a5-4029-ae1f-f524b422f4b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055975 Nov 02 03:34:26.512534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 82/163] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:26.927450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50325c2f-0595-459d-a630-67c40277e9be"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:26.930087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:26.941502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.944505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.945183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.946125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.946763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.947574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.965385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:26.966734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:26.974240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.974953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.975581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:26.976934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:26.977623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:26.978433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.154727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:27.164332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fb91bdfe-1ec5-453e-abb8-91f83ccd0d26 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1516 microversion: 2.1 time: 0.202767 Nov 02 03:34:27.174629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 83/164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:26 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:27.190669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:27.193157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:27.199368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.199922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.200499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.201272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.201723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.202145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.230775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lazy-loading 'flavor' on Instance uuid 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:34:27.305257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:27.403646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d55c39be-3a51-4dad-b670-b15dc795f725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0/action" status: 200 len: 32 microversion: 2.1 time: 0.218263 Nov 02 03:34:27.405756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 84/165] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:34:27 2022] POST /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 03:34:27.416915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:27.418886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:27.429200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.429969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.430780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.432538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.433208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.433941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.599905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:27.608396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c5544c07-3db1-4225-a201-b99d4938a0ba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.196764 Nov 02 03:34:27.608979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:27 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:27.614408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:27.615571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:27.622477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.623469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.624108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.625039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:27.625701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:27.626660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:27.772317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:27.781707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-98e38b27-d8ac-435f-b21f-9b6b27516093 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.170675 Nov 02 03:34:27.787986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:28.634953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:28.635785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:28.644428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:28.645004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:28.645507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:28.647660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:28.648243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:28.648886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:28.678346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:28.705137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d6d9bb16-aae2-40f1-afd2-f5259f02b024 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "POST /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.782529 Nov 02 03:34:28.708017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 82/168] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:34:26 2022] POST /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371/os-volume_attachments => generated 194 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:28.806151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:28.807418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:28.808247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:28.814918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5fd961c2-2555-4e6a-9a9c-0411d809c986 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.183904 Nov 02 03:34:28.815807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 87/169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:28 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:28.815943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:28.816468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:28.817313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:28.818167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:28.818624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:28.819044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:28.957994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:28.966768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-54293640-da00-4499-8a12-7a7da16ae8bc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1362 microversion: 2.1 time: 0.164569 Nov 02 03:34:28.980982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 83/170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:29.838900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:29.840145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:29.846914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:29.847396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:29.847837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:29.848580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:29.849035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:29.849457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:29.986454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:29.990501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:29.991112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:29.994148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-72b1f5ef-01e5-4a03-804b-b011cd60ff22 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.159391 Nov 02 03:34:29.994720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:29 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:29.997759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:29.998560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:29.998918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:29.999605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:30.000134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:30.000709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:30.126564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:30.134856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-543b758c-eb76-42e1-868f-47a12ffe1b5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1548 microversion: 2.1 time: 0.148322 Nov 02 03:34:30.135433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 84/172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:30.161184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:30.161667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:30.167472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:30.167939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:30.168395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:30.169087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:30.169635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:30.170016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:30.265102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-50aa7a66-3717-45f4-8e45-e099be07c847 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107675 Nov 02 03:34:30.265696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 89/173] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 03:34:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:31.020816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:31.021657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:31.038882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:31.039738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:31.040363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:31.041241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:31.041915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:31.042502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:31.200412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:31.209018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c52dc1ce-7094-486c-a01d-5062de76bb3f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.194525 Nov 02 03:34:31.209728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:31 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:32.233148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:32.233148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:32.239851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:32.240363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:32.241004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:32.241704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:32.242147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:32.242354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68620f31-6b17-41c5-9c0f-48ac66097f04", "tag": "eb29890c-297b-42ed-a158-d316f359bc7c"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:32.242828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:32.253965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:32.254450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:32.255212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:32.267827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] Creating event network-changed:eb29890c-297b-42ed-a158-d316f359bc7c for instance 68620f31-6b17-41c5-9c0f-48ac66097f04 on hv-cinder-86020 Nov 02 03:34:32.273427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-f4b8e901-33c0-4ce1-bb44-8a980dfb0821 req-25f7b9dc-745e-483e-9d74-2db85250098c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Nov 02 03:34:32.274764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 86/175] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:32.420798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:32.428957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a30556bf-c8dc-43ae-a51b-23dbe31cf121 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.201198 Nov 02 03:34:32.429655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 90/176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:32 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:33.454764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:33.456139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:33.462499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:33.463185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:33.463621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:33.464342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:33.464801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:33.465221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:33.619475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:33.628481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dc208a22-fb61-4ce7-807c-41be3287c287 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.179522 Nov 02 03:34:33.629188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 87/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:33 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:34.654055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:34.654665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:34.661249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:34.661733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:34.662160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:34.662844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:34.663293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:34.663743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:34.793141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:34.801941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bd942abb-dc74-4e51-aaf9-26cae4008731 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.152374 Nov 02 03:34:34.802839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 91/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:34 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:35.825488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:35.826110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:35.833025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:35.833506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:35.833937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:35.834626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:35.835077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:35.835499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:35.970760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:35.978481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c2a12620-e1e5-4612-b83c-12145f9472e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.157503 Nov 02 03:34:35.979043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:35 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:37.003398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:37.004241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:37.010477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:37.010943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:37.011372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:37.012081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:37.012526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:37.012939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:37.160890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:37.168859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-33d6b4c3-bfc9-45c2-9d99-0585868b046d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.169818 Nov 02 03:34:37.169426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 92/180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:36 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:38.194967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:38.195500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:38.203086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:38.203667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:38.204388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:38.205166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:38.205830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:38.206327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:38.343690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:38.352452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1ca2b052-0a4e-4bcf-b2b5-2e46589a6b76 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.163814 Nov 02 03:34:38.353014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:38 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:39.375193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:39.376006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:39.382290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.382727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.383158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.383856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.384338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.384759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.479257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:39.479896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:39.486598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.487093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.487518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.488247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.488709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.489124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.519622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:34:39.543674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:39.551713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ced2fada-d860-405f-af87-29f36650f57f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.180710 Nov 02 03:34:39.552311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:39 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:39.618267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-725e150c-73a1-4725-bb01-09dd2d3111eb tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 204 len: 0 microversion: 2.1 time: 0.142415 Nov 02 03:34:39.619225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:34:39 2022] DELETE /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 03:34:39.627425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:39.628063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:39.634076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.634498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.634928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.635611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:39.636091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:39.636549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:39.766650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:39.774670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-df885539-6340-45f0-a5bc-2a056097e5d3 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1554 microversion: 2.1 time: 0.151462 Nov 02 03:34:39.775231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:39 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:40.574547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:40.575238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:40.581580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:40.582050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:40.582485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:40.583157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:40.583657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:40.584116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:40.713641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:40.721874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23cc6ab0-1dc5-4f16-b23c-52c02be276b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.151461 Nov 02 03:34:40.722437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:40 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:40.797621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:40.798185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:40.803976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:40.804659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:40.805089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:40.805768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:40.806209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:40.806624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:40.933896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:40.942005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93ffef4d-1494-479a-bcc7-ff2f2130ea4d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1554 microversion: 2.1 time: 0.148828 Nov 02 03:34:40.942568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 95/186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:40 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:41.746265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:41.746877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:41.754917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:41.755399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:41.755839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:41.756671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:41.757126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:41.757553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:41.883505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:41.891168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ac28c18e-c63f-4f65-8c49-d3d80866a20b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.148778 Nov 02 03:34:41.891734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 92/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:41 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:41.965086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:41.965693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:41.971629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:41.972137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:41.972566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:41.973249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:41.973691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:41.974106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:42.100720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:42.108941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3510f969-b859-49df-b63f-4ed5065c8826 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1554 microversion: 2.1 time: 0.147815 Nov 02 03:34:42.109538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 96/188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:41 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:42.914344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:42.915131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:42.923134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:42.923691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:42.924227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:42.925019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:42.925472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:42.925889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:43.074120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:43.077935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-46c244db-6c23-43b5-b163-2f9fedcdd566 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.167383 Nov 02 03:34:43.094884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 93/189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:42 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:43.133744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:43.134252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:43.140382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:43.141002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:43.141509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:43.142284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:43.142942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:43.143439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:43.307393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:43.328728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-21bde2c5-71ef-49a8-b0fb-5d0d35684a80 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1554 microversion: 2.1 time: 0.192914 Nov 02 03:34:43.328728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 97/190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:43 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:43.355683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d35187a7-e849-45e4-ba14-42a1e6e0c371", "name": "network-vif-deleted", "tag": "a0f307cd-33a5-43c2-b214-ffc61e4ce9d8"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:43.367548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:43.368054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:43.368598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:43.575398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] Creating event network-vif-deleted:a0f307cd-33a5-43c2-b214-ffc61e4ce9d8 for instance d35187a7-e849-45e4-ba14-42a1e6e0c371 on hv-cinder-86020 Nov 02 03:34:43.580755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-c1e20290-d2ce-42a6-9d09-31e414a0cca6 req-f9f6b216-6caa-4c00-b850-811eab8f2577 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228728 Nov 02 03:34:43.581360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 94/191] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:44.100963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:44.101575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:44.107627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:44.108424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:44.108936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:44.109762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:44.110277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:44.110768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:44.287861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:44.296021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9174f582-aaa6-4525-be9b-0b4d186838df tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.198784 Nov 02 03:34:44.297405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 98/192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:44 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:44.348977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:44.349694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:44.355675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:44.356183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:44.356618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:44.357297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:44.357744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:44.358163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:44.389200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:44.389675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:44.390138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:44.390627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lazy-loading 'fault' on Instance uuid d35187a7-e849-45e4-ba14-42a1e6e0c371 {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:34:44.437845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fdb70174b404f4abf0bc220d5dd4bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed6d39b2e343548a094be05af24877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:44.446196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e90953ea-7dba-4d1d-9fb4-4a08635a5f63 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 200 len: 1351 microversion: 2.1 time: 0.102340 Nov 02 03:34:44.446689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 95/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:44 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:45.318583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:45.319227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:45.325196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.325679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.326115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.326810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.327267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.327691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.451169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:45.459386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4bb7a248-5d3a-4e46-965f-869dca9ea613 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.144581 Nov 02 03:34:45.460180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 99/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:45 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:45.469900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:45.470587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:45.478495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.478991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.479434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.480418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.480875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.481303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.494514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] HTTP exception thrown: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Request method failure captured: Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 HTTP/1.1 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUVskOZRRSL0bTHN_5L60fvNkf0NuXYDTmnPKs173SdclkJHHDb4qL0HhnGUeKpZIVzrTsBhJsKnkCc7prG-xxs2-kNP-WjLZSqMRbisW7iyuWtd32WOVIVkLe8nl5nHE4T5x-jXODlvt0ib0YfhzOLDzf5o8OXVMRtOFZmSM302hg Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:34:45.499606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ed6d39b2e343548a094be05af24877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}] Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7fdb70174b404f4abf0bc220d5dd4bb1 Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.501128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'd35187a7-e849-45e4-ba14-42a1e6e0c371'} Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:34:45.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.503265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.504497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Returning 404 to user: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:34:45.504497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-804c3b43-b84a-4d17-a418-bf8cc51d6d23 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 404 len: 111 microversion: 2.1 time: 0.035857 Nov 02 03:34:45.504497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 96/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:45 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:34:45.623567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:45.625995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:45.631971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.632465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.632896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.633580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:45.634032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:45.634449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:45.647599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] HTTP exception thrown: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Request method failure captured: Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371/os-volume_attachments HTTP/1.1 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUVskOZRRSL0bTHN_5L60fvNkf0NuXYDTmnPKs173SdclkJHHDb4qL0HhnGUeKpZIVzrTsBhJsKnkCc7prG-xxs2-kNP-WjLZSqMRbisW7iyuWtd32WOVIVkLe8nl5nHE4T5x-jXODlvt0ib0YfhzOLDzf5o8OXVMRtOFZmSM302hg Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:34:45.651838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ed6d39b2e343548a094be05af24877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}] Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7fdb70174b404f4abf0bc220d5dd4bb1 Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.653379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'server_id': 'd35187a7-e849-45e4-ba14-42a1e6e0c371'} Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:34:45.654326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:45.655729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:45.657620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Returning 404 to user: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:34:45.657620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87395627-f529-4d80-843a-6511885812a5 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033973 Nov 02 03:34:45.657620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 100/196] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:34:45 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:34:46.482875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:46.483637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:46.490606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.491084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.491549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.492269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.492718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.493182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.624812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:46.632355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-93f17367-9ffa-459c-b0bc-2b9a208a97e5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.153361 Nov 02 03:34:46.632910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 97/197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:46 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:46.869928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:46.870432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:46.876624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.877102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.877569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.878257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.878707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.879126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.883151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:46.894102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] HTTP exception thrown: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Request method failure captured: Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 HTTP/1.1 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUVskOZRRSL0bTHN_5L60fvNkf0NuXYDTmnPKs173SdclkJHHDb4qL0HhnGUeKpZIVzrTsBhJsKnkCc7prG-xxs2-kNP-WjLZSqMRbisW7iyuWtd32WOVIVkLe8nl5nHE4T5x-jXODlvt0ib0YfhzOLDzf5o8OXVMRtOFZmSM302hg Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:34:46.896398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ed6d39b2e343548a094be05af24877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}] Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7fdb70174b404f4abf0bc220d5dd4bb1 Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.897853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'd35187a7-e849-45e4-ba14-42a1e6e0c371'} Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:34:46.898661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.899904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.901219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Returning 404 to user: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:34:46.901219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5499ab30-f7cb-414e-b3f9-1553d87aea7d tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 404 len: 111 microversion: 2.1 time: 0.031747 Nov 02 03:34:46.901219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 101/198] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:34:46 2022] DELETE /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 03:34:46.906986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:46.907618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] [instance: d35187a7-e849-45e4-ba14-42a1e6e0c371] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:46.913690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.914172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.914609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.915302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:46.915772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:46.916223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:46.929757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] HTTP exception thrown: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Request method failure captured: Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 HTTP/1.1 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUVskOZRRSL0bTHN_5L60fvNkf0NuXYDTmnPKs173SdclkJHHDb4qL0HhnGUeKpZIVzrTsBhJsKnkCc7prG-xxs2-kNP-WjLZSqMRbisW7iyuWtd32WOVIVkLe8nl5nHE4T5x-jXODlvt0ib0YfhzOLDzf5o8OXVMRtOFZmSM302hg Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:34:46.931257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7ed6d39b2e343548a094be05af24877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7ed6d39b2e343548a094be05af24877"}]}] Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: f7ed6d39b2e343548a094be05af24877 Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-DeleteServersTestJSON-1020788247 Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7fdb70174b404f4abf0bc220d5dd4bb1 Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-DeleteServersTestJSON-1020788247-project Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.932701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'd35187a7-e849-45e4-ba14-42a1e6e0c371'} Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:34:46.933450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. Nov 02 03:34:46.934712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:34:46.935850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] Returning 404 to user: Instance d35187a7-e849-45e4-ba14-42a1e6e0c371 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:34:46.935850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-76168734-3246-435c-958f-f89273c9bde4 tempest-DeleteServersTestJSON-1020788247 tempest-DeleteServersTestJSON-1020788247-project] 10.222.0.26 "GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371" status: 404 len: 111 microversion: 2.1 time: 0.030077 Nov 02 03:34:46.935850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 98/199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:46 2022] GET /compute/v2.1/servers/d35187a7-e849-45e4-ba14-42a1e6e0c371 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:34:47.654772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:47.655379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:47.662254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:47.662741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:47.663174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:47.663873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:47.664354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:47.664778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:47.798710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:47.807329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1180d5b1-3851-4c1f-9217-3bc139dadaa7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.156394 Nov 02 03:34:47.807918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 102/200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:47 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:48.836780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:48.838141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:48.847476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:48.848258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:48.848860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:48.849839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:48.850460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:48.851047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:49.072715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:49.080670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:49.083324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fd5498b6-f66d-4cf5-9209-cf06ee6e9bba tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.250844 Nov 02 03:34:49.084580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:48 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:50.107930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:50.108577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:50.117640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:50.118128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:50.118566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:50.119270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:50.122939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:50.126026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:50.330146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:50.339028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58570427-4571-497d-a290-eae8cc711eae tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.235532 Nov 02 03:34:50.339292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 103/202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:50 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:51.367016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:51.368166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:51.380252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:51.381810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:51.382331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:51.383349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:51.388323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:51.388953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:51.617929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:51.634932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d0cf4b5c-d942-43f9-a17d-b62b3b8a1fcf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.272280 Nov 02 03:34:51.635676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 100/203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:51 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:52.658562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:52.659237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:52.661136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=59 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:52.666798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:52.667385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:52.667840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:52.668550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:52.668999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:52.669478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:52.805849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:52.814900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2ea7826e-1e28-4989-b053-d227cfd660e1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.160225 Nov 02 03:34:52.815475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 104/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:52 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:53.281669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1417684744", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "networks": [{"uuid": "667c0bd0-951b-42aa-8d99-0ed85422a4b0"}]}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:53.337290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] validate_networks() for [('667c0bd0-951b-42aa-8d99-0ed85422a4b0', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:34:53.680760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:34:53.681101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:34:53.681566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:34:53.681969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:34:53.682374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:34:53.690872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:53.691343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:53.691771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:53.692512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:53.692962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:53.693381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:53.709831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Getting quotas for project 909fcdad3cef45ad9cf5494524d2b354. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:34:53.713931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Getting quotas for user 7f6abf03a1cb4ecaa8b2edfb8a576418 and project 909fcdad3cef45ad9cf5494524d2b354. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:34:53.725010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:34:53.727211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:34:53.774080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-09ffa83e-50b5-46c0-b444-7cc98bd39c72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496761 Nov 02 03:34:53.774826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 101/205] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:34:53.786623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f9c90cde-048b-4647-a970-0a979f71496a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:53.787243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f9c90cde-048b-4647-a970-0a979f71496a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:53.838979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:53.839511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f9c90cde-048b-4647-a970-0a979f71496a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:53.839834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:53.847201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:53.847797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f9c90cde-048b-4647-a970-0a979f71496a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1219 microversion: 2.1 time: 0.064888 Nov 02 03:34:53.847930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:53.848419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:53.848565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:53.849689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:53.850236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:53.850752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:53.992610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d9ea9d9d-c89b-4a85-8c75-0aa2f11aa894 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c9276c820>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:54.000723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:54.028519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6a29c06a-6e92-426e-8872-892b65e78e89 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.191981 Nov 02 03:34:54.029681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 102/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:53 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:54.066152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d9ea9d9d-c89b-4a85-8c75-0aa2f11aa894 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6347cc95-5db8-446d-8b4e-61cc49b9ef65" status: 200 len: 350 microversion: 2.1 time: 0.079766 Nov 02 03:34:54.066792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 106/208] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:34:53 2022] GET /compute/v2.1/os-volumes/6347cc95-5db8-446d-8b4e-61cc49b9ef65 => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:54.870362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:54.870974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:54.878347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:54.878826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:54.879255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:54.879986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:54.880436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:54.880852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:54.944328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:54.951831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0dbe9ee3-b1ae-4321-a549-5807a6616281 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1271 microversion: 2.1 time: 0.085377 Nov 02 03:34:54.952408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 103/209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:55.054901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:55.055434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:55.062055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:55.063049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:55.063482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:55.064195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:55.064650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:55.065076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:55.190964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:55.198716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3650f96e-5f74-4096-88fe-e06bdfce6b8a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.147795 Nov 02 03:34:55.199280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:55 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:55.440632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-19da75af-f6eb-4447-b802-6ece07a40fd5 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924dc3a0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:55.490882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-19da75af-f6eb-4447-b802-6ece07a40fd5 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/589578ba-91a5-42a1-a493-581e00bc3a7b" status: 200 len: 351 microversion: 2.1 time: 0.054061 Nov 02 03:34:55.491676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 104/211] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:34:55 2022] GET /compute/v2.1/os-volumes/589578ba-91a5-42a1-a493-581e00bc3a7b => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:55.975848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:55.976621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:55.982614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:55.983168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:55.983608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:55.984833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:55.985278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:55.985704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:56.113678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:56.121222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a5f2bc01-2478-455e-885e-87a1945dd932 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.149338 Nov 02 03:34:56.121790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:56.222391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:56.223145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:56.225050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:56.231230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:56.231724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:56.232193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:56.232898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:56.233494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:56.233927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:56.372363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:56.380394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-81523ad9-17ff-4565-927c-4f5668984ac9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.162347 Nov 02 03:34:56.380964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 105/213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:56 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:56.699473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb081e9-a274-4ed2-850c-750041b05e81", "tag": "dc01b58c-e82f-4ea4-bb21-2631ca9a1a03"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:34:56.709753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:56.710289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:56.710922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:56.722761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] Creating event network-changed:dc01b58c-e82f-4ea4-bb21-2631ca9a1a03 for instance 3cb081e9-a274-4ed2-850c-750041b05e81 on hv-cinder-86020 Nov 02 03:34:56.727508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-7bfa4e8f-db9b-4044-b98c-b31fac1b29f5 req-235c4818-e24f-439f-b6d6-d08476ba9c62 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Nov 02 03:34:56.728131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 109/214] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:56.867980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fbe0dd93-f544-447c-835f-92b33132f95d tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924dc3a0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:56.916454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fbe0dd93-f544-447c-835f-92b33132f95d tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d9e48f3b-604c-4fda-83d6-b9dc52c79641" status: 200 len: 350 microversion: 2.1 time: 0.052060 Nov 02 03:34:56.917019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 106/215] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 03:34:56 2022] GET /compute/v2.1/os-volumes/d9e48f3b-604c-4fda-83d6-b9dc52c79641 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:56.930589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-14ee2b5d-9a52-4daf-9e8a-a4522d1a8900 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c925464c0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.015640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-14ee2b5d-9a52-4daf-9e8a-a4522d1a8900 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089114 Nov 02 03:34:57.016352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 110/216] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Nov 2 03:34:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:57.030358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3d2aa09c-0fee-453e-b897-37cb68e0608d tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924d9b80>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.112261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3d2aa09c-0fee-453e-b897-37cb68e0608d tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085629 Nov 02 03:34:57.112829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 107/217] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:57.126448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9fc21985-ec86-4406-b178-2b4e58ee5207 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924f6430>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.144918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.145611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:57.152482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:57.153042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:57.153560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:57.154328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:57.154849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:57.155435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:57.213434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9fc21985-ec86-4406-b178-2b4e58ee5207 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090920 Nov 02 03:34:57.214678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 111/218] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:57.228787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-62c7694c-7284-4a52-8b29-1c2e133cf1e1 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c9252c820>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.295313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:57.302917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ba82a4da-d054-40af-a26f-f45cecd93292 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.161977 Nov 02 03:34:57.303469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 108/219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:57.327657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-62c7694c-7284-4a52-8b29-1c2e133cf1e1 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103320 Nov 02 03:34:57.328820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 112/220] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:57.342135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c1cfc28c-050f-4402-83b4-910e4a2598e3 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924d9e50>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.403322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.404104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:57.410310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:57.410974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:57.411219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:57.411902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:57.412381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:57.412803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:57.423168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c1cfc28c-050f-4402-83b4-910e4a2598e3 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084662 Nov 02 03:34:57.423766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 109/221] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:34:57.438303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e1851970-2f3a-44df-8e53-d8f3c68b6f4a tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c925fe4c0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.525681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e1851970-2f3a-44df-8e53-d8f3c68b6f4a tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091691 Nov 02 03:34:57.526458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 110/222] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:57.539737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b88e337b-75fd-47bf-a053-64aa8c7ab4d0 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c925fe790>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.622526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b88e337b-75fd-47bf-a053-64aa8c7ab4d0 tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086530 Nov 02 03:34:57.623100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 111/223] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:34:57.636742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-246189a9-b4f4-4a49-acda-1727904e06dc tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] Calling method '.version_select at 0x7f5c924d9ee0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:57.681073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:57.689597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a4bd0349-d890-4d23-9114-8025568102cf tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.290011 Nov 02 03:34:57.690179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 113/224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:34:57.718401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-246189a9-b4f4-4a49-acda-1727904e06dc tempest-VolumesTestJSON-1347101159 tempest-VolumesTestJSON-1347101159-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085158 Nov 02 03:34:57.718959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 112/225] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Nov 2 03:34:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:58.326273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:58.327028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:58.333437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:58.333920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:58.334408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:58.335044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:58.335493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:58.335911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:58.460580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:58.468242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bf22163c-ddd7-4238-892e-3c6f64bea3bc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.145883 Nov 02 03:34:58.468817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 114/226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:58.713003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:58.714038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:58.720004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:58.720492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:58.720935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:58.721627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:58.722082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:58.722507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:58.853956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:58.864037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-39ade027-44b4-40dd-a98f-9bc8c713224c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.155325 Nov 02 03:34:58.876086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 113/227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:58 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:59.490327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:59.490940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:59.497007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:59.497495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:59.497931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:59.498873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:59.499328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:59.500299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:59.629491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:34:59.637309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b7789fc-c3d4-4ea6-990e-642644647f0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.150853 Nov 02 03:34:59.637875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 115/228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:34:59.887604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:34:59.888177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:34:59.895029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:59.895511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:59.895967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:34:59.896658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:34:59.897108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:34:59.897531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:00.024336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:00.033850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b20ef8e1-30b6-4084-b568-f3612002c6a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.150127 Nov 02 03:35:00.034430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 114/229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:34:59 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:00.659863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:00.660505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:00.666429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:00.666907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:00.667340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:00.668056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:00.668511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:00.668931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:00.795982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:00.804245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f61931a2-464c-4d0e-b895-32735552aa71 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.148283 Nov 02 03:35:00.804806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 116/230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:01.057220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:01.057762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:01.064842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:01.065390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:01.065745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:01.066450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:01.066898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:01.067321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:01.197836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:01.205856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a3fabf34-d0ad-4172-98f8-74110fd36a59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.152546 Nov 02 03:35:01.206420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 115/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:01 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:01.710910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb081e9-a274-4ed2-850c-750041b05e81", "name": "network-vif-plugged", "status": "completed", "tag": "dc01b58c-e82f-4ea4-bb21-2631ca9a1a03"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:01.723202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:01.723674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:01.724309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:01.736475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] Creating event network-vif-plugged:dc01b58c-e82f-4ea4-bb21-2631ca9a1a03 for instance 3cb081e9-a274-4ed2-850c-750041b05e81 on hv-cinder-86020 Nov 02 03:35:01.741583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-395461d0-5c76-41e0-8d76-feef1170b4a1 req-5616ee46-1481-47be-8ec1-bb8908331c14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034930 Nov 02 03:35:01.742644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 117/232] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:01.836490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:01.837109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:01.844139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:01.845055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:01.845950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:01.846661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:01.847187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:01.848165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:01.992088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:02.001279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-77df5286-19a5-4e7f-aca4-0985f2e759e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.177923 Nov 02 03:35:02.002644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 116/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:02.228696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:02.229403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:02.236187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:02.236667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:02.237098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:02.237782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:02.238231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:02.238652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:02.375032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:02.383500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3ba30cb1-f38e-40e3-9edf-a3b77b90cdf5 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.159203 Nov 02 03:35:02.384443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 118/234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:02 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:03.025013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:03.025632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:03.032013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:03.032499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:03.032939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:03.033666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:03.034253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:03.034690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:03.165551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:03.173953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-336cf9b0-cbd8-4b3c-ad62-2f2577989031 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1319 microversion: 2.1 time: 0.152931 Nov 02 03:35:03.174602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 117/235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:03 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:03.410380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:03.411078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:03.417869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:03.418367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:03.418802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:03.419489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:03.419940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:03.420390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:03.553097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:03.560705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-61620dd7-b567-4bb8-afae-429327942a7d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.154619 Nov 02 03:35:03.561271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 119/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:03 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:04.196300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:04.196914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:04.198799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:04.199438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:04.206484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:04.206963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:04.207398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:04.208146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:04.208607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:04.209030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:04.339431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:04.347113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-824f1f90-a09d-45bd-ad92-1ee4fa215441 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1507 microversion: 2.1 time: 0.154738 Nov 02 03:35:04.347677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 118/237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:04.586676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:04.587369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:04.589527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:04.595419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:04.595996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:04.596500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:04.597260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:04.597718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:04.598139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:04.747922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:04.756032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-950d518b-2f73-49ea-97d0-6d600e72576c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.173648 Nov 02 03:35:04.756914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:04 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:05.778534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:05.779227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:05.786006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:05.786519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:05.786953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:05.787648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:05.788203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:05.788629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:05.946524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:05.956873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ff0aa9e-7bb4-42ce-adb7-f6eb323f3429 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.182243 Nov 02 03:35:05.957712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 119/239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:05 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:06.981426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:06.982035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:06.989538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:06.990008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:06.990450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:06.991203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:06.991670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:06.992551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:07.125677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:07.133578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77227a44-d227-41c8-b1c9-dcd404e74cc2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.155835 Nov 02 03:35:07.134032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 121/240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:06 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:08.158821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:08.159452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:08.165868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:08.166355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:08.166797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:08.167497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:08.167978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:08.168424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:08.303708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:08.311324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eedba730-d118-4eff-bd73-273048f4f8d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.157004 Nov 02 03:35:08.312388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 120/241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:08 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:09.334773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:09.335328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:09.341158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:09.341633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:09.342062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:09.342741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:09.343679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:09.344129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:09.469146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:09.476759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e8b7e03b-ff2b-440a-a2ce-e476b84c95d4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.146025 Nov 02 03:35:09.477322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 122/242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:09 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:10.499392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:10.500590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:10.509130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:10.509612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:10.510048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:10.510745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:10.511203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:10.511630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:10.648773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:10.657259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-db1258e7-2ae3-4fc3-a571-1fd93b6a7c01 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.162030 Nov 02 03:35:10.657809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 121/243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:10 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:11.680188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:11.681375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:11.689177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:11.689843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:11.690443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:11.691492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:11.692123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:11.692691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:11.827399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:11.835413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e03a12e1-b4d7-42d6-b4ab-b1f6a63b493b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.159116 Nov 02 03:35:11.847973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 123/244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:11 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:12.862789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:12.863665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:12.870410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:12.870902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:12.871339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:12.872086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:12.872550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:12.872970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:13.022515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:13.031895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d34f18d5-7882-4948-96f4-02deb7e06435 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.177379 Nov 02 03:35:13.032637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 122/245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:12 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:14.064560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:14.065204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:14.072899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:14.073766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:14.074582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:14.076152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:14.076803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:14.077382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:14.222303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:14.233512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:14.240498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad2a0d9c-3ce2-4b36-8196-35208741299b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.187074 Nov 02 03:35:14.241536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 124/246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:14 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:15.264255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:15.265391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:15.272301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:15.272790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:15.273226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:15.273954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:15.274463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:15.274887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:15.404354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:15.412166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3523cbba-429a-4761-90fa-379873eeb02e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1522 microversion: 2.1 time: 0.151731 Nov 02 03:35:15.412965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 123/247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:15 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:16.435573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:16.437026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:16.443829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:16.444782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:16.445384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:16.446269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:16.447001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:16.447592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:16.585357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:16.593760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e25edc0c-be79-4fe0-9e81-dbe30c198fca tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1502 microversion: 2.1 time: 0.161500 Nov 02 03:35:16.594316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 125/248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:16 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:16.615578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:16.616147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:16.622396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:16.622870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:16.623319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:16.624344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:16.624793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:16.625212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:16.629264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:16.756821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:16.764871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f50c7261-0a69-4bdc-954b-87a80ae336b6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1516 microversion: 2.1 time: 0.153203 Nov 02 03:35:16.765540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 124/249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:16 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:18.201519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:18.204386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:18.211120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:18.211618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:18.212082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:18.212913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:18.213367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:18.213792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:18.242726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lazy-loading 'flavor' on Instance uuid be47a8e9-ddac-4b17-bbc7-11128bfcf574 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:35:18.332906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-870876a6-9385-4742-8197-cce2472ed6e2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/action" status: 200 len: 32 microversion: 2.1 time: 0.135578 Nov 02 03:35:18.333630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 126/250] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:35:18 2022] POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/action => generated 32 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 03:35:18.344149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:18.344941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:18.357936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:18.359198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:18.359673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:18.360848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:18.361498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:18.362070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:18.564047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:18.584973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f640d4fe-46a7-4591-aa97-b10b868a59e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.244589 Nov 02 03:35:18.588553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 125/251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:18 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:19.144632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:19.145211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:19.151413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:19.151789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:19.152244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:19.152925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:19.153367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:19.153785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:19.180526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e99248d5-b35f-4fb2-a9ba-c0f21206fe41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/ips" status: 200 len: 151 microversion: 2.20 time: 0.040071 Nov 02 03:35:19.181305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 127/252] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Nov 2 03:35:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:35:19.609946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:19.610562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:19.617823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:19.618311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:19.618756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:19.619467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:19.619919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:19.620373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:19.972899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:19.980944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4f82f230-afbb-4d83-bb70-0d2f57528a0c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.375279 Nov 02 03:35:19.981591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 126/253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:19 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:21.005545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:21.006606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:21.012794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:21.013414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:21.016625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:21.016625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:21.016625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:21.016625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:21.169199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:21.179494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae6f345a-1038-4fec-b7ca-5948df1b16e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.177765 Nov 02 03:35:21.180160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 128/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:21 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:22.161466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:22.161969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:22.168669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.169148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.169614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.170307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.170753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.171239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.198883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0e9aee65-591a-49ac-85f3-00189a341d92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/ips" status: 200 len: 149 microversion: 2.1 time: 0.042859 Nov 02 03:35:22.199451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 127/255] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:35:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:22.203608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:22.204255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:22.210716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.211295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.211889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.212743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.213280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.213781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.458434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:22.471657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-865a2391-d398-4290-ba47-7d929f5b456f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.272481 Nov 02 03:35:22.472282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 129/256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:22 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:22.814190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:22.815062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:22.822495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.823283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.823934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.824929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:22.825744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:22.826390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:22.863363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lazy-loading 'flavor' on Instance uuid a5773140-5308-4eaf-8557-2d9739c592ea {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:35:23.127129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6851c4b3-5243-48d6-9cde-87cf1b763b51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/action" status: 202 len: 0 microversion: 2.20 time: 0.317738 Nov 02 03:35:23.128048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 128/257] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 03:35:22 2022] POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 03:35:23.139033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:23.140807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:23.148411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=46 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:23.151280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.151995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.152588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.153475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.154330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.154778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.290530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:23.302144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:23.303621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:23.305268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6dfb36ef-b786-4fc5-b96a-cc31606729e6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.170577 Nov 02 03:35:23.306072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 130/258] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:23.496530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:23.497292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:23.505656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.506019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.506455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.507224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.507670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.508158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.698163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ddbcc7-42b3-4d2a-b510-d9199c40d255"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:23.700682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:23.707176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.707901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.708602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.709306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:23.709768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:23.710359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:23.839470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:23.850425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-030e5e2d-2e2f-4f13-ad80-6b02d9cecd43 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.359399 Nov 02 03:35:23.851344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 129/259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:23 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:24.079456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0de6fa0b-7822-47d1-a283-a51e17ad7b0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385042 Nov 02 03:35:24.080473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 131/260] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:35:23 2022] POST /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:35:24.334369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:24.334999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:24.342155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:24.342629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:24.343620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:24.344523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:24.345138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:24.345724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:24.482987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:24.491025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:24.492520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:24.493671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7a10d268-9bc1-4f99-8bd3-27baf35fab86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.164333 Nov 02 03:35:24.494227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 130/261] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:24.877109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:24.877809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:24.884447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:24.884929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:24.885364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:24.886054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:24.886512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:24.886932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:25.018408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:25.026184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-834ed8d1-2fd1-4eb1-a9a4-5430399ec426 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.154216 Nov 02 03:35:25.026748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 132/262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:24 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:25.520013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:25.520552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:25.527117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:25.527602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:25.528069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:25.528771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:25.529239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:25.529688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:25.655898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:25.664031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:25.665485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:25.666634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c2883133-5412-46ee-8116-c4c92334561f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.150621 Nov 02 03:35:25.667192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 131/263] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:26.049912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:26.050525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:26.057112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:26.057559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:26.057995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:26.058682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:26.059135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:26.059554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:26.198282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:26.205968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6389a517-17ad-4e44-8237-fb13ce7277e7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.160662 Nov 02 03:35:26.206526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 133/264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:26 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:26.694114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:26.695240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:26.698653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=42 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:26.706737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:26.707081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:26.707577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:26.708304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:26.708754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:26.709177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:26.841293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:26.850364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:26.851798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:26.852990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2b14125a-06ae-4cd2-ab81-d93c989d58fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.164516 Nov 02 03:35:26.853571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 132/265] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:27.228778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:27.229421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:27.235944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:27.236486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:27.236887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:27.238133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:27.238595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:27.239098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:27.396590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:27.399499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fde206d8-56c3-49f6-856c-62d28f0c38d2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.174639 Nov 02 03:35:27.400597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 134/266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:27 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:27.878612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:27.879255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:27.885174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:27.885657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:27.886092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:27.886782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:27.887234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:27.887661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:28.021793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:28.029901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:28.031879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:28.033168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b026abfd-1909-4a9a-8b7a-03bbaf402dbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.158402 Nov 02 03:35:28.033723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 133/267] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:28.422467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:28.423082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:28.429743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:28.430611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:28.431121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:28.432093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:28.432652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:28.432991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:28.608021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:28.623302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e7ab12d2-0b32-4991-aa13-222926b309da tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.205129 Nov 02 03:35:28.625799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 135/268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:28 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:29.066856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:29.067696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:29.076959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.078316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.078761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.079624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.080328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.080909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.217018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:29.225253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:29.226671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:29.227838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f682e51f-417b-4697-b176-744b65a14e70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.173566 Nov 02 03:35:29.228504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 134/269] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:29.297936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e72407f-a795-40c3-a2b0-43421ffd4458", "device": "/dev/sdb"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:29.300796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:29.302448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:29.303008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:29.306731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.307208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.307634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.308353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.308878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.309205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.309946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.310760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.311196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.312715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.313203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.313850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.343069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d1505253-4937-4249-889e-356f88a46040 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/ips" status: 200 len: 146 microversion: 2.1 time: 0.043835 Nov 02 03:35:29.344475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 135/270] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:35:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:29.624911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-17b51df0-ade4-485e-87f6-c19e9edae14c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "POST /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330124 Nov 02 03:35:29.626272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 136/271] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:35:29 2022] POST /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:29.649515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:29.652398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:29.659466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.660343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.661131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.662072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:29.662608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:29.663146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:29.851366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:29.861241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cc6c381b-88dc-4f48-8454-6bf777e0c499 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.216605 Nov 02 03:35:29.876507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 136/272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:29 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:30.254371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:30.255051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:30.261120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:30.261595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:30.262019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:30.262731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:30.263174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:30.263593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:30.268255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:30.401456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:30.410330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:30.411741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:30.412923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d909dc42-aa70-4c31-8e3f-57ef19a3e374 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.163320 Nov 02 03:35:30.413478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 137/273] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:30.887905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:30.888538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:30.894840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:30.895327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:30.895766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:30.896492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:30.896948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:30.897376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:31.024758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:31.032508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-31c0c15d-d842-4298-8f9e-05effa375137 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.148560 Nov 02 03:35:31.033072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 137/274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:30 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:31.438010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:31.438543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:31.445592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:31.446676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:31.447116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:31.448022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:31.448474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:31.448898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:31.582577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:31.591081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:31.592572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:31.594320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4d9c5e94-6b35-443d-8d2f-8badc7fb00bd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.160328 Nov 02 03:35:31.594908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 138/275] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:31.799447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bc4db72f-8fc0-47e5-ae65-86c0ac7193e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: .version_select at 0x7f5c92593700>, body: {"keypair": {"name": "tempest-keypair-1666293079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmHIXcjCeuHQhlmAL4x+W1umGtK0M4Qxkz09wJXT78dyMAMAd+BygpEv3d2eOF1oDK+4Uv7KAUG1+f3e4Wpr7teZd6O4aWRG6tIYwD8+WP8RT5b/QxH0F45ZZt1qnIotA=="}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:31.815066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-bc4db72f-8fc0-47e5-ae65-86c0ac7193e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:35:31.819108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-bc4db72f-8fc0-47e5-ae65-86c0ac7193e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:35:31.841699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bc4db72f-8fc0-47e5-ae65-86c0ac7193e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046650 Nov 02 03:35:31.842275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 138/276] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 03:35:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:32.056011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:32.056623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:32.064056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:32.064551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:32.064994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:32.065695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:32.066154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:32.066584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:32.220464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:32.229634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-14f39d87-7a02-4d9b-96a7-6743468b200a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.177377 Nov 02 03:35:32.231871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 139/277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:32 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:32.621244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:32.621863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:32.635475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:32.635984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:32.636600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:32.637343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:32.637802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:32.638222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:32.812145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:32.820616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:32.822068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:32.823342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-936e30a5-9dcc-454e-9d4b-31fe3ebfb5ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.207095 Nov 02 03:35:32.823898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 139/278] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:33.255315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:33.255923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:33.262593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.263072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.263506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.264232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.265177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.265592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.398354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:33.406595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a758ece8-0ffb-4cb5-9503-8deef5f37caa tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.155245 Nov 02 03:35:33.407165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 140/279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:33 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:33.421415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-336284393", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e09a0e-4e79-4d08-a329-49c34bfe3e5f"}], "security_groups": [{"name": "tempest-securitygroup--1465341814"}], "key_name": "tempest-keypair-1666293079", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:33.520544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] validate_networks() for [('d4e09a0e-4e79-4d08-a329-49c34bfe3e5f', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:35:33.853583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:33.854426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:33.861855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.862877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.863525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.864470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.865131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.865775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.893250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:35:33.894412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:35:33.895075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:35:33.895739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:35:33.896378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:35:33.909387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.910255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.911502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.912566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:33.913037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:33.913483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:33.940776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:35:33.944703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:35:33.960475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:35:33.963121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:35:34.023760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:34.024880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2fb18c79-906e-48b8-b96b-bd446d18f903 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607712 Nov 02 03:35:34.028503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 140/280] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:35:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:35:34.033524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:34.035121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:34.036426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-73317e84-2333-44a1-bf41-b06ae4c074a3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.187395 Nov 02 03:35:34.036543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ec28cdc6-edde-4a93-965d-befe6767b437 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:34.037121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ec28cdc6-edde-4a93-965d-befe6767b437 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:34.037283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 141/281] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:34.094926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ec28cdc6-edde-4a93-965d-befe6767b437 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:34.102056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ec28cdc6-edde-4a93-965d-befe6767b437 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1241 microversion: 2.1 time: 0.069162 Nov 02 03:35:34.102801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 141/282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:34 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:34.231992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56db1ca3-5e28-4aee-b414-88c9dbf61785"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:34.234639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:34.240761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:34.241248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:34.241681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:34.242566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:34.243031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:34.243465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:34.433474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:34.434401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:34.442998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:34.443656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:34.444097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:34.444936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:34.445314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:34.445890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:34.450765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:34.575885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6488f10c-f7f1-43b5-99cc-520c5001b822 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347631 Nov 02 03:35:34.582355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 142/283] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:35:34 2022] POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:34.631415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:34.639251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-615627fa-b400-4405-9fbb-8c081f18c0b8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.212621 Nov 02 03:35:34.640060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 142/284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:34 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:35.063027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:35.064113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:35.070199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.070677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.071109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.071795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.072262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.072681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.126850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:35.127465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:35.136232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.137120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.137565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.138271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.138724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.139145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.219478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:35.227089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-767ef5df-3c1a-413d-a026-c272be124928 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1293 microversion: 2.1 time: 0.104836 Nov 02 03:35:35.227735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 143/285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:35 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:35.253384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:35.261925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:35.263397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:35.264608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ee8f4f82-6176-4d22-bfd4-79e435da4a1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.206279 Nov 02 03:35:35.265172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 143/286] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:35.663351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:35.664012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:35.670428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.671406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.671837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.672546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:35.672995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:35.673418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:35.809343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:35.817249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3d711faf-d4b2-4238-ac1c-f5e5d45bab20 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.157727 Nov 02 03:35:35.817819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 144/287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:35 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:36.255650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:36.257032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:36.264197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.265453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.265897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.266632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.267264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.267697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.293140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:36.294588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:36.310187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.312135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.312750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.313618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.314100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.314525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.359246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:36.366915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-29d22fb2-5dd8-4239-bc52-a93752bfa3a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1311 microversion: 2.1 time: 0.118129 Nov 02 03:35:36.367470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 144/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:36 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:36.455082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:36.463117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:36.464584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:36.465738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0bb177b0-5397-43fa-9cab-9dbbb4430847 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.177642 Nov 02 03:35:36.466286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 145/289] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:36.839716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:36.840561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:36.846862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.847371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.847803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.848526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:36.849131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:36.849547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:36.996906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:37.005561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bf8fd5a6-52d6-439f-a968-744538ce5c2b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.169505 Nov 02 03:35:37.006137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 145/290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:36 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:37.391088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:37.391762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:37.398254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:37.398803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:37.399235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:37.399930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:37.400412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:37.400835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:37.493376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:37.494730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:37.501678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:37.502636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:37.503094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:37.503784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:37.504645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:37.505090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:37.530556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:37.538354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-86cb7908-7274-45b6-956e-ab2a106d843a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.151208 Nov 02 03:35:37.539113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:37 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:37.643325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:37.651458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:37.652923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:37.654078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c52ee112-3d55-4bbf-a879-4add3a7033f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.164668 Nov 02 03:35:37.654645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 146/292] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:38.029095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:38.029702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:38.035798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.036424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.036928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.037731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.038221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.038644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.224053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:38.231871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb30f3cf-9a07-4437-836a-4397e4bd7f55 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.206619 Nov 02 03:35:38.232467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 147/293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:38 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:38.282072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462d4a05-6687-47b8-b2c9-942b76d76274", "tag": "1489ae3e-0675-40a6-9bd0-e6cba2ef51f5"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:38.292996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.293564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.294058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.307813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] Creating event network-changed:1489ae3e-0675-40a6-9bd0-e6cba2ef51f5 for instance 462d4a05-6687-47b8-b2c9-942b76d76274 on hv-cinder-86020 Nov 02 03:35:38.313564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-7706c26b-74af-44fa-8ec6-88a6090ff050 req-101be7f7-9d28-4656-a1a4-18713525e811 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Nov 02 03:35:38.314157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 147/294] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:38.562830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:38.563577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:38.569928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.570406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.570837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.571574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.572036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.572466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.681056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:38.681761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:38.688966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.689427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.689870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:38.690577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:38.691030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:38.691457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:39.025029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:39.033356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c8246c47-09c0-43a5-bdcd-df5e6c9590a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.475075 Nov 02 03:35:39.040392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 148/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:38 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:39.048299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:39.056929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:39.058383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:39.059737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-83991531-81ed-4a22-8b31-51bd69fbce65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.383085 Nov 02 03:35:39.060371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 148/296] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:39.257671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:39.258588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:39.265599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:39.266976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:39.267693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:39.268815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:39.269424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:39.270006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:39.427730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:39.435449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cf631a86-0d49-4843-9393-895dedcb7aa8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.182874 Nov 02 03:35:39.435981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 149/297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:39 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:40.057410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:40.058015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:40.064341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.064817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.065241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.065931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.066394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.066791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.085436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:40.086044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:40.094190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.094717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.095157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.095859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.096340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.096776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.289746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:40.293619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:40.302713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1666bf71-3b4c-4a2f-8896-70adb0bd429e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.248058 Nov 02 03:35:40.302893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:40.303825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 149/298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:40 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:40.304174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:40.305533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48249e6a-1d80-4bdc-bc76-1453cf7a0c2a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.223994 Nov 02 03:35:40.306350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 150/299] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:40.461103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:40.461836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:40.468322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.468778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.469213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.469906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:40.470355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:40.470777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:40.612840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:40.636472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f4f39df-f5ca-4740-a29f-d27c9a08003b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.179078 Nov 02 03:35:40.637053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 150/300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:40 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:41.326344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:41.327643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:41.331255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:41.331909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:41.334663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.334984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.335599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.336576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.337048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.337547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.338106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.338590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.339018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.339699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.340362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.341091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.547982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:41.554939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:41.555110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2cf9e8ed-db52-43ed-800b-de5f899694aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.232618 Nov 02 03:35:41.556300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 151/301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:41 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:41.565044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:41.566577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:41.567741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e283223-dfdc-453a-820d-0885b604dd8b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.241197 Nov 02 03:35:41.568317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 151/302] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:41.659541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:41.660268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:41.666513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.666995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.667432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.668553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:41.669022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:41.669451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:41.806016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:41.814292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bb8d5a7a-6978-43b7-a90b-6d55ef8035ac tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.158631 Nov 02 03:35:41.814854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 152/303] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:41 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:42.579178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:42.579785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:42.586194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.586671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.587104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.587794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.588269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.588695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.592746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:42.593451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:42.599811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.600323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.600784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.601474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.601925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.602346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.778474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:42.789056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:42.789898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b415dac6-7e1f-4f28-8952-53c19cabdcbf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215054 Nov 02 03:35:42.790555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 152/304] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:42 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:42.797165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:42.798602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:42.799743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b9620e1-4adf-4970-bcbf-280e4b92463e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.211001 Nov 02 03:35:42.800744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 153/305] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:42.838438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:42.839347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:42.845413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.845888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.846321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.847003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:42.847449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:42.847868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:42.852010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:42.973187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:42.980740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2187c0cd-8e5d-4b14-a3f3-d8c0ea8e3df2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.146969 Nov 02 03:35:42.981295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 153/306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:42 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:43.813867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:43.814938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:43.821984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:43.822475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:43.822918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:43.823623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:43.824346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:43.824764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:43.827049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:43.827663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:43.841392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:43.841880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:43.842318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:43.843015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:43.843467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:43.843893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:43.925910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:44.099218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=12 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:44.228683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.232727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.237191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0aac125d-44d3-4c4d-b768-51a89497a22b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.427818 Nov 02 03:35:44.237760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 154/307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:43 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:44.241803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.242271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:44.243006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:44.243530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.244740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f36e4ab8-b395-4a9a-992f-d3a511b685c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1723 microversion: 2.20 time: 0.421636 Nov 02 03:35:44.245451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 154/308] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:44.252777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.252777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.252777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.252777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.253149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.253149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.379303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.386974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-57a492c1-319e-496c-9085-14c553f07725 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1502 microversion: 2.1 time: 0.148280 Nov 02 03:35:44.387528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 155/309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:44 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:44.412860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85cb7616-4b02-46bd-a817-57982b65e3f3"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:44.415352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:44.421431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.421912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.422349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.423030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.423476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.423896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.446588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] HTTP exception thrown: Cannot 'attach_volume' instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 while it is in vm_state rescued Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Request method failure captured: Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/os-volume_attachments HTTP/1.1 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 74 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUX7Fjpv_cpvBLq2XyaWk1SRwq4WNH8YyddLJ3eYAiY_7kt-S192VwaR9lEW_e8ZU9YRq6hina_0vlavYScXSX0Ri7J4OX8_WxC7R7XuIUT_jyITOODLtQrwQlWPBLOMZyTxNrxLgFDXwlWgFedVg6CLp1NWE_jjmm_qrosr-PhE7c Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:35:44.448293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}] Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: eed64456ec5c42b08df447e9a537c4d0 Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {"volumeAttachment": {"volumeId": "85cb7616-4b02-46bd-a817-57982b65e3f3"}} Nov 02 03:35:44.449553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Cannot 'attach_volume' instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 while it is in vm_state rescued Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'server_id': 'be47a8e9-ddac-4b17-bbc7-11128bfcf574', 'body': {'volumeAttachment': {'volumeId': '85cb7616-4b02-46bd-a817-57982b65e3f3'}}} Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:35:44.450294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 while it is in vm_state rescued Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:35:44.451352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 while it is in vm_state rescued Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Returning 409 to user: Cannot 'attach_volume' instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 while it is in vm_state rescued {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-16232cb4-4df2-4c35-be76-7094c40ab6b7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040844 Nov 02 03:35:44.452902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 155/310] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:35:44 2022] POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 03:35:44.459126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:44.459656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:44.465462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.465938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.466365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.467066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.468091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.468510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.538304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e9060568-9e5d-4ded-8942-6961a933ae59 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/action" status: 202 len: 0 microversion: 2.1 time: 0.077696 Nov 02 03:35:44.538304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 156/311] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:35:44 2022] POST /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:35:44.543777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:44.544866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:44.551838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.553191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.554230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.555703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:44.556208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:44.557024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:44.694298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:44.702670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-81a4ece3-c4bb-4ea2-983e-25abd7c8a0a4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.162045 Nov 02 03:35:44.703220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 156/312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:44 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:45.260871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:45.261579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:45.268411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.268903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.269346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.270051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.270512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.282608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.282887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:45.282887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:45.282887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.282887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.283584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.283584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.283584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.283584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.462866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:45.466569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:45.466897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:45.472118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7b0cda48-12be-4ee5-b699-1370daeb97a2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215851 Nov 02 03:35:45.472687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 157/313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:45 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:45.475664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:45.477124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:45.478260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3422b877-91d4-4a5c-bf71-e9592d384723 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.211419 Nov 02 03:35:45.478797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 157/314] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:45.729209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:45.729788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:45.737080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.737521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.737976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.738656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:45.739134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:45.739569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:45.872854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:45.881162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d1838640-3510-4a54-b4a2-8ae4e61b618c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.156422 Nov 02 03:35:45.881807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 158/315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:45 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:46.494800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:46.495446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:46.502257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.502742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.503182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:46.503888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.504016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:46.504438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.504617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:46.504781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:46.510910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.511397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.511835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:46.512560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.513018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.513448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:46.698601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:46.703726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:46.707013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8746fdb1-f567-44f6-a2cb-971defe9c44a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.216043 Nov 02 03:35:46.707587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 158/316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:46 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:46.713997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:46.715451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:46.716717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-79dcaa36-93c5-4e3f-8105-51f329b8166b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.216618 Nov 02 03:35:46.722654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 159/317] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:46.903678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:46.904338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:46.910885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.911364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.911798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:46.912512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:46.912972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:46.913392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:47.040556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:47.048213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b0fba325-4cfe-46d7-b19d-2fcebbe06e0b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.148279 Nov 02 03:35:47.048776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 159/318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:46 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:47.729103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:47.729722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:47.736796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:47.737504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:47.738036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:47.738430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:47.738880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:47.739310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:47.743609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:47.744339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:47.750990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:47.751711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:47.752240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:47.753068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:47.753578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:47.754063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:47.938073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:47.945847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-78eb8221-3821-420a-934c-c8ecab3b96bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.220553 Nov 02 03:35:47.960206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:47.960206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:47.960559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 160/319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:47 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:47.961629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:47.962784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6763f18e-7ada-4476-8eab-ae9dae7f3eca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.223143 Nov 02 03:35:47.963370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 160/320] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:48.070976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:48.071591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:48.078000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.078481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.078911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.079600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.080071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.080493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.196665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462d4a05-6687-47b8-b2c9-942b76d76274", "name": "network-vif-plugged", "status": "completed", "tag": "1489ae3e-0675-40a6-9bd0-e6cba2ef51f5"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:48.212418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.212910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.213390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.218861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:48.226839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] Creating event network-vif-plugged:1489ae3e-0675-40a6-9bd0-e6cba2ef51f5 for instance 462d4a05-6687-47b8-b2c9-942b76d76274 on hv-cinder-86020 Nov 02 03:35:48.227117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-afc65a7f-be9e-441e-940e-c802145e880e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.159977 Nov 02 03:35:48.227861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 161/321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:48 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:48.232432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-8efd32c1-bf6f-478f-b041-587d1ef89a59 req-4a01c3fc-d8ce-4200-81e1-70c79006c0cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039747 Nov 02 03:35:48.233286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 161/322] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:35:48.969506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:48.970113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:48.976366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.976836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.977262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.977937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.978382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.978797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.989282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:48.989970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:48.996435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.996913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.997341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:48.998028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:48.998474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:48.999785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:49.171937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:49.178953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:49.179488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-41a8c470-28e9-49f2-8a5b-68acb3178ff1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.214218 Nov 02 03:35:49.180074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 162/323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:48 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:49.187901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:49.189452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:49.190667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1776d48b-71c0-4183-8c3a-f192c9efec19 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.205577 Nov 02 03:35:49.191212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 162/324] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:49.249968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:49.250512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:49.256334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:49.256816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:49.257253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:49.257940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:49.258392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:49.258818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:49.384021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:49.391623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21737258-dd58-4d08-b1dc-9ae8e1e83d18 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.145804 Nov 02 03:35:49.392215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 163/325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:49 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:50.203093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:50.203705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:50.210249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.210735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.211173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.211861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.212347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.212771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.214559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:50.215165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:50.221371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.221847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.222278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.222960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.223407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.223829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.405751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:50.412203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:50.414237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ed32df4e-02ef-40e0-ad77-eed7e9e021ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215492 Nov 02 03:35:50.414812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 163/326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:50 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:50.419198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "name": "network-vif-plugged", "status": "completed", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:35:50.421062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:50.422521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:50.423672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-12d8edd8-92eb-4c16-93e8-ab7f73a95fb7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213011 Nov 02 03:35:50.424247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 164/327] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:50.428766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:50.428907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.429254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.429521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:50.429681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.435314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.435871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.436952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.437712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:50.438238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:50.438731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:50.441326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] Creating event network-vif-plugged:1d12b4d0-54ad-447a-8d59-df5c58c000f7 for instance a5773140-5308-4eaf-8557-2d9739c592ea on hv-cinder-86020 Nov 02 03:35:50.446134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-0fd26218-f810-4efb-a035-08c4cb97b7fb req-de06a702-a2c9-4caa-93c3-6055c910c1e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Nov 02 03:35:50.446911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 164/328] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:35:50.568432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:50.576115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3be20698-47a0-4dbf-91d8-52728bf2ced2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.150667 Nov 02 03:35:50.576755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 165/329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:50 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:51.449326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:51.450031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:51.456831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:51.457296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.457433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:51.457530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.457922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.458612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.459062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.459489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.463669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.464180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.464612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.465293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.465738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.466157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.652752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:51.655800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:51.660589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f879896e-50f3-4764-973c-dcfee2fb4688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215935 Nov 02 03:35:51.661985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 165/330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:51 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:51.663941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:51.665436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:51.665557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:51.666121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:51.666590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-962b3713-9a0b-4299-acce-d1ad6fe5eb9e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213624 Nov 02 03:35:51.667418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 166/331] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:51.671803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.672326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.672760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.673445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:51.673895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:51.674314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:51.802199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:51.810075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5c2d2adc-ac3e-49f4-8253-26f202720107 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147966 Nov 02 03:35:51.810655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 166/332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:51 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:52.683769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:52.684412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:52.690887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.691221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:52.691638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.691794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:52.691932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:52.692834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.693290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.693717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:52.704108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.704723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.705155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:52.705840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.706287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.706728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:52.896755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:52.900568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:52.904799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ec7c2e6e-d3d2-450c-a3c0-443075e779eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.224763 Nov 02 03:35:52.905892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 167/333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:52 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:52.910261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:52.910507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:52.911111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:52.911934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:52.913175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ecd18bd-df08-46f6-b3f4-99f2390a7e04 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.226635 Nov 02 03:35:52.914014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 167/334] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:52.916018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:52.917626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.918284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.918888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:52.919786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:52.920426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:52.921001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:53.048410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:53.056110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0297810f-b381-44fc-9b0b-29b3f022542a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.149173 Nov 02 03:35:53.056605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 168/335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:52 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:53.929335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:53.929972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:53.932132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=76 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:53.937136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:53.937624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:53.938066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:53.938680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:53.939123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:53.939221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:53.939607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:53.940219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:53.948075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:53.948570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:53.949018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:53.949882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:53.950693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:53.951153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:54.142113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:54.146421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:54.150334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a020fdb5-ad23-4660-b40d-1a4f0a4da135 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.224810 Nov 02 03:35:54.156831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:54.158496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:54.159652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-99eb6276-b5d2-462a-9e20-76af8f9c0cb0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.225051 Nov 02 03:35:54.160245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 169/336] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:54.164335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 168/337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:53 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:54.164528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:54.165123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:54.170729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:54.171208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:54.171642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:54.172390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:54.172847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:54.173268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:54.301502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:54.309214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-237aa09f-99ef-400a-a398-9bb1a7544e1a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147998 Nov 02 03:35:54.309777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:54 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:55.173578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:55.174214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:55.180741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.181217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.181648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.182326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.182772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.183189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.185794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:55.186889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:55.193203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.193690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.194124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.194813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.195266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.195691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.377380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:55.380630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:55.385055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6a7d21f7-17a6-425f-be87-6375b490456e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215369 Nov 02 03:35:55.385621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 169/339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:55 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:55.389939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:55.390569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:55.391168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:55.391389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:55.392623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cff0cd92-96b0-480b-89e2-53ec1ad5b3bb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.210994 Nov 02 03:35:55.393276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 171/340] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:55.396807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.397291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.397791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.398485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:55.398938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:55.399361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:55.526349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:55.534120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3fc34129-d554-4fe2-b92b-9c96214b5d47 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147532 Nov 02 03:35:55.534686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 170/341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:55 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:56.409789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:56.410321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:56.416944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.417351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:56.417767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.417865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.417983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:56.418560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.419013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.419439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.424188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.424664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.425093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.425781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.426224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.426637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.444056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:56.610392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:56.613645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:56.618053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1108813c-16a9-4a4c-a679-449d415cb021 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.212247 Nov 02 03:35:56.618696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 172/342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:56 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:35:56.621715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:56.623031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:56.623166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:56.624213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:56.624876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6f6d2f77-8b37-4dbd-9b5c-9e839f6c5de2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.211328 Nov 02 03:35:56.627156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 171/343] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:56.629912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.630389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.630819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.631501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:56.632309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:56.632429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:56.757662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:56.765231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4b3d0cb7-5a49-491d-8cdd-429e78c70726 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.145599 Nov 02 03:35:56.765791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 173/344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:56 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:57.641844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:57.642493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:57.649036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.649515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.649948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.650324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:57.650776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.650958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:57.651104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.651529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.656972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.657460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.657903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.658592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.659051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.659502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.678403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:57.842700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:57.845846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:57.850418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-110fc762-6ba8-4b92-a347-628057018419 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.212851 Nov 02 03:35:57.851156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 172/345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:57 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:57.855462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:57.856086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:57.859695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:57.861175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:57.862038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.862324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7e4b2de3-d10b-413e-a5dc-1e0e61da405f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.216225 Nov 02 03:35:57.862523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.862870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 174/346] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:35:57.863003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.863615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:57.864088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:57.864512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:57.994161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:58.002416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d9071027-244a-4267-bb2d-bf1b48933b3e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.150428 Nov 02 03:35:58.002974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 173/347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:57 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:58.873969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:58.874521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:58.881134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:58.881641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:58.882078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:58.882778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:58.883239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:58.883661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:58.888596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:58.889787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:58.896006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:58.896552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:58.896985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:58.897671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:58.898116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:58.898537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:59.082289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:59.086111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:59.090031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ae3ad290-8539-41ca-a0a8-e8f153a2c27f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.220181 Nov 02 03:35:59.090595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 175/348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:58 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:35:59.095012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:59.095571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:35:59.096233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:35:59.096494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:59.097659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-74d47f4a-5572-4e99-b082-832e10064a7b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213298 Nov 02 03:35:59.098341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 174/349] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:35:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:35:59.101947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:59.102427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:59.102861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:59.103545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:35:59.104027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:35:59.104443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:35:59.230699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:35:59.238865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5e254c1d-321c-4340-ab38-49dc1283ab77 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147348 Nov 02 03:35:59.239414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 176/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:35:59 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:00.112893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:00.113505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:00.120150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.120636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.121073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.121761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.122214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.122568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:00.122973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.123177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:00.129754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.130228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.130659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.131338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.131785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.132229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.313742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:00.317739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:00.321638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18be31da-b248-449e-8171-c021a7410567 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.212503 Nov 02 03:36:00.322208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 175/351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:00 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:36:00.325755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:00.327721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:00.328095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:00.328709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:00.328922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1d606e06-99a0-447c-b183-4f856b473e00 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.210086 Nov 02 03:36:00.329623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 177/352] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:00.335255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.335733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.336198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.336881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:00.337325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:00.337737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:00.461729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:00.469879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5574d85a-1adb-4803-bec9-3711bf0c1889 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.146648 Nov 02 03:36:00.470440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 176/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:00 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:01.344068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:01.344679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:01.350958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.351433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.351864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.352578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.353025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.353441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.354126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:01.354767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:01.360773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.361297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.361674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.362356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.362799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.363219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.537257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:01.545094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-32d1db60-d813-46cf-88a1-4f83dce6c658 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.204798 Nov 02 03:36:01.545882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:01 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:01.547846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:01.550504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:01.551237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:01.556777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:01.557249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.557834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.558201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:01.558466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.559266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:01.559359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bbcb1284-bb23-4772-b53e-c7b6d79e8fa6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.208976 Nov 02 03:36:01.560033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 177/355] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:01.560154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:01.560501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:01.690926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:01.698528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-632d1b50-9258-457b-84ed-492eed7392e4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.151624 Nov 02 03:36:01.699093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 179/356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:01 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:02.568167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:02.568806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:02.575177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.575650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.576116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.576827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.577272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.577688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.585218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:02.585916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:02.592373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.592853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.593296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.593986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.594444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.595240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.770515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:02.773823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:02.778154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e8c233c8-5740-4076-9992-784b667b39e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.213844 Nov 02 03:36:02.778722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 178/357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:02 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:02.782519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:02.783549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:02.783996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:02.784205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:02.785162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-482d9d13-ea42-4f0d-a417-1dbc147c2ec6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.203797 Nov 02 03:36:02.785857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 180/358] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:02.789902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.790566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.791117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.791873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:02.792432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:02.792921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:02.923365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:02.931007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ea2a4dce-47ee-4ec4-a909-6595d1bd9bd8 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.151282 Nov 02 03:36:02.931488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 179/359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:02 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:03.801545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:03.802094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:03.808521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:03.808999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:03.809438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:03.810126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:03.810579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:03.811511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:03.815046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:03.815658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:03.821963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:03.822447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:03.822885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:03.823584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:03.824062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:03.824487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:04.009725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:04.012694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:04.017716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ecd60d10-4cc0-4df7-b45b-209b75be24e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.220046 Nov 02 03:36:04.018294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:03 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:04.021088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:04.022520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:04.022791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:04.023392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:04.023671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f8a69664-ed9a-4f62-bc5b-41f20a4d9363 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.212981 Nov 02 03:36:04.024518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 180/361] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:03 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:04.029222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:04.029699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:04.030133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:04.030821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:04.031267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:04.031688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:04.158842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:04.166464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-deed1fd7-151e-4b0b-8ab1-8dc153d0ec7f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147241 Nov 02 03:36:04.167026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 182/362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:04 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:05.040460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:05.041067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:05.048345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.048815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.049193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:05.049574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.049864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:05.049967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.050345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.050758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.056372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.057076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.057657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.058449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.059104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.059641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.253219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:05.256299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:05.260975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-88a8c13d-bf77-482d-bebd-9f56030b0fb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.224441 Nov 02 03:36:05.261869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 181/363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:05 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:05.264754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:05.266134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:05.266260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:05.266766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:05.267383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3a3ed297-7951-44c8-a736-2bfe841e6180 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.222628 Nov 02 03:36:05.272252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 183/364] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:05.272584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.273076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.273496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.274178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:05.274625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:05.275042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:05.410902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:05.418545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b20b50c8-ae8c-4d5d-a14a-fefbd8da3a70 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.155822 Nov 02 03:36:05.419110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 182/365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:05 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:06.284077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:06.284695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:06.291987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.292481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.292922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.293628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.294079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.294507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.294813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:06.295430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:06.301840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.302318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.302752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.303437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.303915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.304354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.487462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:06.490553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:06.496477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:06.498016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84321e82-e71d-4189-b924-92d5135751be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.218424 Nov 02 03:36:06.498131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:06.498584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 184/366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:06 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:06.499495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a612fd8f-410b-4879-9337-2fdb91783099 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.208192 Nov 02 03:36:06.500151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 183/367] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:06.503715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:06.504472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:06.510070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.510550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.510984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.511670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:06.512149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:06.512574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:06.639478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:06.647664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-44f9032d-1f0d-454d-990c-6104d4cb6796 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147888 Nov 02 03:36:06.648244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 185/368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:06 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:07.521194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:07.521810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:07.525729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:07.526336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:07.529173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.529669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.530108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:07.530808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.531255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.531675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:07.533652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.534135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.534573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:07.535264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.535714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.536177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:07.919888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:07.924518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:07.928211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-31aa84ec-db05-4e0a-9257-c42c7b70d2e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.411425 Nov 02 03:36:07.928782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 184/369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:07 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:07.932858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:07.933208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:07.933804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:07.934317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:07.935465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1abb9569-5b9a-43bd-aff3-b4c1a3e14986 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.413668 Nov 02 03:36:07.936190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 186/370] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:07.939570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.940080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.940514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:07.941202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:07.941652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:07.942073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:08.069255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:08.076859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ddaa8db8-a38c-4b04-841b-a513666138c1 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147151 Nov 02 03:36:08.077414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 185/371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:07 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:08.950629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:08.951162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:08.957603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:08.958088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:08.958524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:08.959218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:08.959669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:08.960123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:08.960331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:08.960942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:08.967379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:08.967858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:08.968317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:08.969007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:08.969459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:08.970375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:09.149989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:09.153928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:09.157833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cfa4ad3b-ac37-4458-a424-705d645de946 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.211071 Nov 02 03:36:09.158392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 187/372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:08 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:09.161964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:09.162774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:09.163372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:09.163485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:09.164567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-40424ff3-7f62-4ca7-adea-bac0edc754d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.208052 Nov 02 03:36:09.165217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 186/373] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:09.168910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:09.169392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:09.169824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:09.170502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:09.170948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:09.171391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:09.300433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:09.308099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8fa010cf-d79f-4616-a28e-ef27406164f0 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.148742 Nov 02 03:36:09.308680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 188/374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:09 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:10.182546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:10.183186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:10.189448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.189714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:10.190599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.190807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:10.190922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.191513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.191972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.192414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.197095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.197575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.198007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.198689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.199136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.199591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.384689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:10.388609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:10.394441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-445c121b-3c87-4373-9338-f0e8abcc576c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215668 Nov 02 03:36:10.395008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 187/375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:10 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:10.397286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:10.398726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:10.399453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:10.399860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f8dee023-74d8-477f-a0e0-9a77f021126c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.214011 Nov 02 03:36:10.400075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:10.400431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 189/376] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:10.405957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.406428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.406868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.407537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:10.408023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:10.408443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:10.412328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:10.537790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:10.545500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4a6aeb1d-a9cb-40ff-bdea-12568f8ba2a9 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.149529 Nov 02 03:36:10.546053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 188/377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:10 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:11.417365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:11.417969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:11.425040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.425516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.425946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.426100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:11.426638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.426736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:11.427085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.427503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.433009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.433486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.433920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.434606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.435053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.435509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.617157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:11.624416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:11.625105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-de444292-183f-44f2-be49-2f6b955fc630 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.211613 Nov 02 03:36:11.625673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:11 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:11.632142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:11.632778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:11.632971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:11.634224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:11.635372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b0d76d80-cd69-41c9-b09a-269ffcf48fc6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213763 Nov 02 03:36:11.636200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 189/379] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:11.639094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.639645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.640180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.640948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:11.641473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:11.641967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:11.646838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:11.778389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:11.786082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6eddef7d-7426-4190-a311-93b901c528c7 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.157493 Nov 02 03:36:11.786652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 191/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:11 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:12.656781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:12.657418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:12.660878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:12.661492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:12.664565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.665047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.665473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:12.666157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.666602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.667018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:12.667785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.668295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.668734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:12.669421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.669881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.670304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:12.856755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:12.863877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:12.865441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:12.866903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:12.868092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-827ee144-19c1-48df-a636-bf4223103d0e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.211481 Nov 02 03:36:12.868657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 192/381] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:12.871718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a04f1403-99e2-4ef5-98f9-a751f2a8b345 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.219208 Nov 02 03:36:12.872516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 190/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:12 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:12.872986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:12.873593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:12.880699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.881549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.882274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:12.883476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:12.884341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:12.885040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:13.019068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:13.026765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f60b8fe1-fbf8-4dc6-8b23-c4e86dd7dd94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.157172 Nov 02 03:36:13.027327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 193/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:12 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:13.895242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:13.895805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:13.896181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:13.896431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:13.902418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:13.902750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:13.902900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:13.903240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:13.903392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:13.903680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:13.904191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:13.904435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:13.904648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:13.904891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:13.905071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:13.905316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:14.091559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:14.098170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:14.099552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1571e3b2-2776-43db-a04e-de8538787cb0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.208735 Nov 02 03:36:14.100185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 191/384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:13 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:14.104663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:14.105269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:14.106730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:14.108209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:14.109395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce8351cc-83b8-4151-a4fa-b921aadaf54b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.218026 Nov 02 03:36:14.113639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 194/385] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:14.113774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:14.113774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:14.113774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:14.113774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:14.114081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:14.114081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:14.240736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:14.248430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-43d53f99-2e12-46b5-9307-44ffc41862f2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.147349 Nov 02 03:36:14.249259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:14 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:15.122347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:15.122890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:15.129824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.130303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.130737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.131421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.131870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.132350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.134670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:15.135133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:15.141363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.141835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.142264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.142949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.143894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.144339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.326622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:15.330438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:15.334779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7a8c1f39-fb05-4ed0-8fe7-69e3b1ce5432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.216340 Nov 02 03:36:15.335430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 195/387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:15 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:15.339093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:15.340451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:15.340565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:15.341063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:15.341692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d566d250-3ccc-4ce1-b039-fdcac00015cf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.211090 Nov 02 03:36:15.342233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 193/388] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:15.351838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.351838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.351838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.351838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:15.352227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:15.352227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:15.481665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:15.489218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-76ef2fc3-2019-458d-bfa3-d2f801f3c640 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.152864 Nov 02 03:36:15.489772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 196/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:15 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:16.358065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:16.358677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:16.365165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.365645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.366077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.366768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.366876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:16.367264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.367489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:16.367637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.374095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.374590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.375030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.375722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.376210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.376644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.562983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:16.568185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:16.571328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4063aa52-e907-4732-910c-4a019481ce07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.217056 Nov 02 03:36:16.571901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 194/390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:16 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:16.576287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:16.576770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:16.576897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:16.578404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:16.579663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4d6f6e36-d945-46c2-a0f1-5bd8e7c3b483 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.216903 Nov 02 03:36:16.580360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 197/391] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:16.582537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.583021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.583458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.584184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:16.584639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:16.585062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:16.714492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:16.722147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6dc606d0-e76f-498a-97a4-f8203f8bcd30 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.149289 Nov 02 03:36:16.722745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 195/392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:16 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:17.594185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:17.594798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:17.601736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.602212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.602643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.603323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.603769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.604215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.604691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:17.605304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:17.611657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.612171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.612608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.613297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.613747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.614170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.797033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:17.800827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:17.804703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9cdd66b6-4b34-4101-ae56-2032ede2030a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.214345 Nov 02 03:36:17.805265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 198/393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:17 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:17.808985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:17.809611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:17.810215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:17.810434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:17.811614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3770daf4-b07b-4c43-ae99-102117057370 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.210959 Nov 02 03:36:17.812316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 196/394] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:17.816485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.816968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.817400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.818083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:17.818531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:17.818953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:17.943588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:17.951086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-faaa6ff7-e4b0-4837-b1a8-f85e6fb7da27 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.144867 Nov 02 03:36:17.951633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 199/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:17 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:18.829110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:18.829655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:18.836722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:18.837218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:18.837354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:18.837720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:18.837919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:18.838312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:18.838765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:18.839185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:18.844233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:18.844706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:18.845135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:18.845824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:18.846955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:18.847376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:19.028571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:19.035754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:19.036898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e2d307a9-0da5-4b42-b344-276078785652 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.211622 Nov 02 03:36:19.037470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:18 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:19.041962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:19.042573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:19.044075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:19.045517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:19.046677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-949bab21-56ba-4366-945c-187256cf8887 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213210 Nov 02 03:36:19.047533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 200/397] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:19.048333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:19.048820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:19.049266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:19.049942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:19.050396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:19.050819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:19.182183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:19.190638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6ad52c43-0d8b-45ec-a27e-29cc96eaf31e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.151402 Nov 02 03:36:19.190854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:19 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:20.060115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:20.060721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:20.067247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.067730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.068186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.068871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.069323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.069744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.072141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:20.072762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:20.079056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.079565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.080022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.080715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.081170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.081595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.265687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:20.268871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:20.274444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-74e45930-ec77-451a-acd5-d6fe6f7856c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.218105 Nov 02 03:36:20.275610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:20 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:20.277800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:20.279250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:20.280442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-526149c9-38a9-463c-ac0a-47cccc9e91cc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.212244 Nov 02 03:36:20.285549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 199/400] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:20.286771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:20.287542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:20.297552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.298042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.298484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.299187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:20.299641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:20.300087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:20.429968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:20.437777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-101d66f9-799a-41a4-b2db-79b0fea5d555 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.160657 Nov 02 03:36:20.438339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 202/401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:20 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:21.302041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:21.302648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:21.309151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.309709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.310064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.310768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.311221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.311640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.323555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:21.324200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:21.331864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.333062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.333505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.334225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.334675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.335758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.515342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:21.518612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:21.523762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc8c67b6-0873-4849-8002-c9c5b9bd4151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.225555 Nov 02 03:36:21.528122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 200/402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:21 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:21.528290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:21.529185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:21.529418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:21.530252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:21.530913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a6229a9-9f0f-4dd5-b05b-ba4e217742e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.228952 Nov 02 03:36:21.531320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 203/403] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:21.537302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.537969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.538613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.539460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:21.540082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:21.540674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:21.668724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:21.676751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4c3134cb-09e7-4815-87c7-b5ce969a692a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.150822 Nov 02 03:36:21.677309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 201/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:21 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:22.547217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:22.547837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:22.554751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.555233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.555666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.556381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.556655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:22.557093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.557242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.557370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:22.563760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.564322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.564875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.565564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.566010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.566431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.746543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:22.750757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:22.756243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d285de39-6bc5-4332-af4e-021c81c21ed2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.212826 Nov 02 03:36:22.756999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 204/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:22 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:22.760121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:22.761678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:22.762913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7cef20c4-077d-41c8-aaf5-f5342ff92306 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.210743 Nov 02 03:36:22.763644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 202/406] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:22.776910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:22.777539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:22.783527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.784048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.784484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.785178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:22.786187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:22.786580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:22.913707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:22.921651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ae81a833-99df-4e46-b477-c9f0cfcacc6d tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.152718 Nov 02 03:36:22.922209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:22 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:23.784630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:23.785271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:23.787771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:23.788427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:23.790708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=76 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:23.791806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:23.792327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:23.792774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:23.793470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:23.793935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:23.794344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:23.796081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:23.796564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:23.797000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:23.797704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:23.798142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:23.798563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:23.981539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:23.989664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc12eedb-b8e5-41e2-ae73-b3449864c161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.208870 Nov 02 03:36:23.990227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 203/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:23 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:23.994706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:23.995260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:23.995405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:23.997097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=72 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:24.002703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:24.003192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:24.003781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:24.005078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:24.005364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:24.005659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:24.006195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:24.006820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:24.007986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-25214fb8-c514-49ff-b0e3-283590c6ccb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.224210 Nov 02 03:36:24.008546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 206/409] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:24.138474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:24.141870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:24.147215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9cc9586f-932a-4a9b-8595-7efc59109d15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.156035 Nov 02 03:36:24.147816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 204/410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:23 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:25.014454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:25.015068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:25.021960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.022434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.022866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.023547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.024015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.024438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.034129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:25.034736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:25.041592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.042072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.042504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.043195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.043642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.044087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.204624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:25.208654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:25.214074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-20221cae-8dfd-4a8d-83d1-6b6bf99e58d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.203410 Nov 02 03:36:25.214646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 207/411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:25 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:25.219069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:25.219679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:25.225415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:25.230219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.230778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.231219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.231915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:25.232411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:25.232816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:25.233425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:25.234866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:25.236042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-17ff3802-516d-4112-8fb4-3945fbc57218 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.205955 Nov 02 03:36:25.236769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 205/412] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:25.361162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:25.368814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b40a527b-e31c-4b2d-9f7a-3631326ee6f4 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.153228 Nov 02 03:36:25.369499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 208/413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:25 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:26.236418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:26.237028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:26.243354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.243833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.244314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.244999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.245449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.245875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.261011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:26.261633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:26.267908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.268423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.268862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.269556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.270572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.271003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.442469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:26.446633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:26.450065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ddfb1d42-55fe-4bdf-a406-b58540c33e5c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.217420 Nov 02 03:36:26.450625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:26 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:26.454727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:26.456274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:26.457949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-525dec52-4710-4995-9d02-3d2e4c313458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.200238 Nov 02 03:36:26.458638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 209/415] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:26.460541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:26.461174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:26.466765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.467235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.467664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.468368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:26.468813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:26.469229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:26.599669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:26.607689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8dc59791-7f9a-40e8-aef4-989e1fb81e7a tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.155841 Nov 02 03:36:26.608218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 207/416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:26 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:27.473818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:27.474425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:27.480573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.481051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.481487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.482170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.482342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:27.482754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.482981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:27.483087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.489978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.490446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.490877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.491554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.492019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.492436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.674401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:27.680450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:27.683090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-86fec553-c564-4f6a-9775-0e0f7e23e84e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.213590 Nov 02 03:36:27.684002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 210/417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:27 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:27.688459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:27.689071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:27.694891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.695379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.696475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.697367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:27.697828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:27.698259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:27.703340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:27.705094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:27.706248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f558a731-8851-4d9e-8d28-f83646535dee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.227727 Nov 02 03:36:27.706791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 208/418] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:27.826498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:27.834577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63da8666-ac1d-4d9b-949e-0cf2ed821151 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.149635 Nov 02 03:36:27.835141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 211/419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:27 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:28.704986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:28.705581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:28.712698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.713099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.713498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:28.714183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.714627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.715040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:28.731671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:28.732463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:28.739071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.739560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.740018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:28.740720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.741172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.741595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:28.914969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:28.918111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:28.922659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2b7f7fe0-4170-43c6-881b-7e4507319ee2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.221470 Nov 02 03:36:28.923215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:28 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:28.926862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:28.928207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:28.928364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:28.928809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:28.929530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-87ea8c48-03f7-4488-b2bb-8bb031335f65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.201626 Nov 02 03:36:28.930258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 212/421] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:28.934336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.934814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.935478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:28.936242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:28.936855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:28.937283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:29.063406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:29.071139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dc5b4faf-3c31-40b4-8c74-696b849e9971 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.146992 Nov 02 03:36:29.071762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:28 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:29.947034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:29.947650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:29.954433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:29.954614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:29.955052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:29.955157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:29.955326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:29.956045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:29.956493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:29.956915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:29.961149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:29.961621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:29.962048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:29.962736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:29.963178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:29.963594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:30.150361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:30.154305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:30.158638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:30.160247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:30.161414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce100697-0288-48cc-bfbd-0b73e84c2d0a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.210702 Nov 02 03:36:30.162235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-50ae0966-aedb-4a66-9f6e-82509528cf2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.218819 Nov 02 03:36:30.162343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 211/423] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:30.163197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 213/424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:29 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:30.166301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:30.166895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:30.172548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:30.173021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:30.173452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:30.174125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:30.174571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:30.174988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:30.301995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:30.309726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-db914700-b400-43db-a0dc-8130c5fbe0ab tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.146801 Nov 02 03:36:30.310287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 212/425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:30 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:31.185035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:31.185606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:31.190757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:31.191358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:31.192629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.193108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.193909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.194611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.195067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.195494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.198220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.198692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.199126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.199806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.200281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.200697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.380455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:31.388198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f72a5da-b2de-49f9-b2b2-7eb33b1fe766 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.207091 Nov 02 03:36:31.388761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 214/426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:31 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:31.393237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:31.393836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:31.394489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:31.400195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.400682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.401121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.401825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:31.402255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:31.402679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:31.403936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:31.405405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:31.406555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dd6e1b14-2120-427b-aa1d-086cc0f68962 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.219624 Nov 02 03:36:31.407134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 213/427] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:31.534817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:31.542684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-62708a93-6183-435c-bfba-511f26288d1c tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.152992 Nov 02 03:36:31.543275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 215/428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:31 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:32.411239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:32.411776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:32.418261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.418738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.419174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.419863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.420342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.420764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.430477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:32.431083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:32.437405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.437883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.438325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.439008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.439518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.439943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.609802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:32.617421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f6627f03-eb83-473a-a9e2-e4ac73c841b7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.210659 Nov 02 03:36:32.618050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 214/429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:32 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:32.620410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:32.622449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:32.623052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:32.628899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.629510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:32.629864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.630297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.630914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:32.631027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:32.631418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:32.631837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:32.632109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4fdd2484-a192-465a-be6d-0d5463a3f825 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.205418 Nov 02 03:36:32.632827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 216/430] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:32.756351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:32.763939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87437437-6e47-4275-ba3f-dfa78b54dc15 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.144958 Nov 02 03:36:32.764517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 215/431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:32 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:33.640933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:33.641537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:33.648177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.648693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.649148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.649888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.650341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.650765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.657612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:33.658217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:33.665007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.665481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.665914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.666601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.667053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.667473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.843049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:33.846884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:33.851233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-500836a8-e7a1-47b1-9d81-b87424af378c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.214077 Nov 02 03:36:33.851804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 217/432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:33 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:33.855605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:33.856404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:33.857008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:33.857110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:33.858194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87cc2702-0a21-40e3-b9c0-5005f78a14e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.204458 Nov 02 03:36:33.858730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 216/433] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:33.863723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.863723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.863723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.864541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:33.864792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:33.865217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:33.993934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:34.001967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-918f2673-8569-4b6f-ba1d-418da3cb00c2 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.149127 Nov 02 03:36:34.002529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 218/434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:33 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:34.873773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:34.874564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:34.881260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:34.881744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:34.882179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:34.882900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:34.883293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:34.883711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:34.883795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:34.883910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:34.890270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:34.890738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:34.891169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:34.891889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:34.892365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:34.892790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:35.077113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:35.081202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:35.085749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-89f74425-cfc9-4bfe-a104-95fdd3d4f364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.215861 Nov 02 03:36:35.086394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 217/435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:34 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:35.089989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:35.090976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:35.091429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:35.091703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:35.092607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4993e96f-672a-40d4-9543-51c0105ecd13 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.213311 Nov 02 03:36:35.093310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 219/436] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:34 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:35.097494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:35.098111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:35.098615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:35.100137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:35.100662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:35.101160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:35.426811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:35.434557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ab908506-e4ae-4ec9-8f96-8c1815501d94 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.347162 Nov 02 03:36:35.435114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 218/437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:35 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:36.108958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:36.109420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:36.116302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.116779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.117207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.117889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.118336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.118446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:36.118851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.119054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:36.126197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.127048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.127677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.128652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.129872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.130487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.306012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:36.313638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-787d024b-73d4-4cff-9a87-89cbcdb7527b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.208637 Nov 02 03:36:36.314199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 220/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:36 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:36.319653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:36.327692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:36.329145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:36.330304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8a320686-648b-435a-8ad4-b78b3f9e9c5c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1744 microversion: 2.20 time: 0.215780 Nov 02 03:36:36.330877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 219/439] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:36.458494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:36.459063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:36.464968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.465451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.465890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.466572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:36.467028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:36.467454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:36.599496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:36.610260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4eea720b-1a5e-4b8e-af56-675f6cc54c36 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.155200 Nov 02 03:36:36.619580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 221/440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:36 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:36:37.336679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:37.337296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:37.343621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.344142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.344582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.345274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.345730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.346158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.354450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:37.355089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:37.361366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.361842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.362277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.362963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.363421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.363842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.534471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:37.542301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1fef5a6f-f39d-40f6-b3c6-f3ef7345cd64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.210052 Nov 02 03:36:37.542877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 220/441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:37 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:37.548138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:37.556870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:37.558333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:37.559507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-579ac4b3-0c4b-449f-ac06-f706fb9a9a93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.208879 Nov 02 03:36:37.560065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 222/442] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:37.635026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:37.635641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:37.641464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.641950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.642390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.643083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:37.643539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:37.643985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:37.661394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:37.778978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:37.787175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a9d2787a-57cb-4bf4-b400-3cbd5ce7efd6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.155404 Nov 02 03:36:37.787723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 221/443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:37 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:38.363871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:38.370754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.371245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.371721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.468961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Going to try to stop instance {{(pid=125411) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 03:36:38.497977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:38.521894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-28727418-c391-497e-b452-46d863270f12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action" status: 202 len: 0 microversion: 2.1 time: 0.161083 Nov 02 03:36:38.522950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 223/444] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:36:38 2022] POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:36:38.531389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:38.532621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:38.540713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.541229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.541861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.542631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.543242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.543824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.567565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:38.569115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:38.576206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.576706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.577149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.577854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.581390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.582041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.771407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:38.780777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9a47a479-a663-4a9c-b6ee-0026700471ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.217692 Nov 02 03:36:38.790394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:38.796745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 224/445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:38 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:36:38.799685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fee6e6e2-6dde-4bc5-b97c-60fdd534c098 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.272347 Nov 02 03:36:38.811972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:38.811972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:38.811972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.811972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.812416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.821722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.821722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.821722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.826152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 222/446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:38.832221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:38.833078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:38.841711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.842454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.843194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:38.844253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:38.844886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:38.845470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:39.061299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:39.070150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:39.070329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:39.071756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:39.073370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a1567151-9fb7-4711-b4ad-4e1fabf83796 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.275496 Nov 02 03:36:39.079415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77a5ddb9-76e9-46fb-9c4b-de15668e0b00 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.250910 Nov 02 03:36:39.080229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 223/447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:38 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:39.092494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 225/448] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:39.808498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:39.809764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:39.816743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:39.817233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:39.817676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:39.818373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:39.818825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:39.819269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:39.828743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:39.829353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:39.846297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:39.846799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:39.847245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:39.847985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:39.848474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:39.848926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:40.088993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.097100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a0fea665-989b-4f8e-b2d7-50b1700780fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1367 microversion: 2.1 time: 0.292367 Nov 02 03:36:40.098375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 224/449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:39 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:40.113977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.117321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c0667e08-f997-4065-b4ba-a140890e17ad tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.292328 Nov 02 03:36:40.124386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 226/450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:40.124679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:40.124679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:40.124847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:40.124847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:40.128518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:40.129244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:40.129780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:40.130200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:40.130606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:40.131170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:40.131844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:40.132240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:40.132366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:40.132791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:40.133315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:40.133950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:40.348767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.357215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-86b7c7b4-eaa5-4012-a6ee-14a857b8e949 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1510 microversion: 2.1 time: 0.238306 Nov 02 03:36:40.364238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 227/451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:40 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:40.364430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.377197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.378763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:40.380687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e935021b-caf4-4d62-a235-efad61d42d2e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.264106 Nov 02 03:36:40.384966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 225/452] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:41.122435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:41.123761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:41.131127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.131613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.132076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.132779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.133398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.133971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.144231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:41.145596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:41.163871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.164666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.165281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.166171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.166777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.167386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.408922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.416740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.419025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-af082fd4-a5ec-4d83-bd31-14e7c46a3dda tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.278433 Nov 02 03:36:41.420286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 226/453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:41.425539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:41.426276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:41.432951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.433811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.434447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.435341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.435977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.436553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.441073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-12b86b3f-3b98-4128-b07a-1504449d34c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1556 microversion: 2.1 time: 0.322759 Nov 02 03:36:41.445051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 228/454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:41 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:41.460149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:41.460149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:41.473662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.474399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.476220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.478095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.480619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.481144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.675010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.684323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-10a76beb-f041-4fdc-8bb1-32bf35f5f3ff tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1516 microversion: 2.1 time: 0.262686 Nov 02 03:36:41.688066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 227/455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:41 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:41.693106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:41.693693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:41.700211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.700820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.701358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.702184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:41.702749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:41.703304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:41.714961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.727184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.729748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:41.731318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d815b0e1-7b0f-467d-a8fb-9a07f97d3e46 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.284632 Nov 02 03:36:41.732790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 229/456] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:41.803263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8ebdf8d7-e0b2-4cb6-9bb3-8aed0a59c6d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114045 Nov 02 03:36:41.804313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 228/457] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 03:36:41 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:36:42.443561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:42.444188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:42.451688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:42.452286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:42.452813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:42.453913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:42.454437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:42.454922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:42.740802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:42.762977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:42.764078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:42.775682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:42.776809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e0177a8c-77f7-4aae-92f7-00b0c7dd03e9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.337555 Nov 02 03:36:42.777269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:42.777786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:42.792549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 230/458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:42.792767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:42.792767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:42.792767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:43.013249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:43.026123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:43.049814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:43.052538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-814ea471-1dc5-4965-ab9b-5ba6e0da55b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.293722 Nov 02 03:36:43.053365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 229/459] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:43.135689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462d4a05-6687-47b8-b2c9-942b76d76274", "tag": "1489ae3e-0675-40a6-9bd0-e6cba2ef51f5"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:43.146709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:43.147512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:43.148330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:43.159970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] Creating event network-changed:1489ae3e-0675-40a6-9bd0-e6cba2ef51f5 for instance 462d4a05-6687-47b8-b2c9-942b76d76274 on hv-cinder-86020 Nov 02 03:36:43.165775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-52f5ec3a-b46e-4d16-8ee0-b6f2d5270d45 req-c69585a1-8f81-4851-ad8b-691c1306f142 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Nov 02 03:36:43.170667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 231/460] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:36:43.805407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:43.806168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:43.818545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:43.820285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:43.820729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:43.821457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:43.824340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:43.824774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:44.010255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:44.019105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1e34645a-8a31-4d4a-9af9-524a0e12b82d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.218067 Nov 02 03:36:44.022975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 230/461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:44.097223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:44.097223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:44.108463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:44.116481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:44.117323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:44.118272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:44.122618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:44.123326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:44.360624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:44.377427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:44.379398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:44.396798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6ad86c4e-29dd-4630-b0e1-1d3d09675dda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.318148 Nov 02 03:36:44.409282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 232/462] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:45.048477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:45.049746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:45.057001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:45.057682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:45.060374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:45.061095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:45.061550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:45.061972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:45.216924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:45.226059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-06aa5e7e-2e08-4707-9c46-53999c663ecc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.181482 Nov 02 03:36:45.236980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 231/463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:45.422706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:45.423321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:45.433313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:45.434077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:45.434683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:45.435568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:45.436208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:45.436787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:45.607722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:45.616721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:45.618224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:45.619408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5abedfb3-6104-498a-a4ed-ba8eb98a94f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.200608 Nov 02 03:36:45.619983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 233/464] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:46.250722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:46.251926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:46.258449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:46.258935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:46.259372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:46.260133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:46.260580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:46.261009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:46.408796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:46.418115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-105425b4-336a-4ba1-8f70-b79195b32327 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.171851 Nov 02 03:36:46.432370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 232/465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:46.650848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:46.651551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:46.658751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:46.659367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:46.659822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:46.661169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:46.667063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:46.667830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:46.810713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:46.819489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:46.820967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:46.822472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1f71d010-5933-4053-9ac2-f4e83fe5797b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.176414 Nov 02 03:36:46.823411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 234/466] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:47.442693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:47.443301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:47.449561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:47.450059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:47.450751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:47.451541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:47.452117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:47.452606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:47.617973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:47.626625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-937175f3-8d56-4de3-9d8d-361b233d65eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.187885 Nov 02 03:36:47.627199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 233/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:47.856260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:47.857032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:47.865105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:47.865610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:47.866056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:47.866762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:47.867224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:47.867653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:48.005770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:48.013984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:48.015428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:48.016607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3cacfe12-82ec-4ed4-86bd-b2308822c22e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1739 microversion: 2.20 time: 0.164733 Nov 02 03:36:48.017292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 235/468] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:48.652263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:48.652883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:48.659281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:48.659752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:48.660225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:48.660971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:48.661483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:48.661906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:48.796174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:48.805089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-636d7474-94ae-4136-9efd-8346c0bf4cc3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.159080 Nov 02 03:36:48.820220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 234/469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:49.041002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:49.041646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:49.048106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:49.048577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:49.048971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:49.049665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:49.050122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:49.050556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:49.187023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:49.195834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:49.197332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:49.198492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-33ed7c0d-43e3-42cf-89f3-c7b29196ab11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1721 microversion: 2.20 time: 0.161407 Nov 02 03:36:49.199052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 236/470] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:49.827823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:49.828396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:49.834783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:49.835260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:49.835693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:49.836410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:49.836864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:49.837285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:49.961922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:49.970106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-15b373c9-e617-4cd3-a2d6-b474d60ccd79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.146148 Nov 02 03:36:49.970665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 235/471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:50.223372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:50.224550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:50.230927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:50.231393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:50.231825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:50.232551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:50.233004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:50.233453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:50.365252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:50.373400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:50.375113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:50.376297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c8dd5e15-d7ce-4fef-b8b5-229ce16f39f0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1721 microversion: 2.20 time: 0.156793 Nov 02 03:36:50.376849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 237/472] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:50.994233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:50.994872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:51.001739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.002241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.002698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.003416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.003897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.004388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.137700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:51.147035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-84e58024-eca7-491c-b403-f9d90c1da732 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.157214 Nov 02 03:36:51.147567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 236/473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:51.402098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:51.402882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:51.409568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.410057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.410494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.411193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.411647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.412098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.541345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:51.549519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:51.550973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:51.552168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cf684b65-c872-4a7e-9eb9-4329f8377baf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1724 microversion: 2.20 time: 0.153952 Nov 02 03:36:51.552723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 238/474] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:51.577044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "221a3ef3-f606-4729-bcac-30398981019d"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:51.579491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:51.585511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.585985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.586414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.587088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:51.587537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:51.587969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:51.756733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:51.875333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-95b6d1c7-737b-49bb-ad60-eaf4be1535a6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302262 Nov 02 03:36:51.875932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 237/475] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Nov 2 03:36:51 2022] POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:36:52.006245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:52.006838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:52.012646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.013124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.013562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.014249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.014696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.015123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.047992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "name": "network-vif-unplugged", "status": "completed", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:52.060333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125411) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 03:36:52.061744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.062227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.062651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.073796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.compute.server_external_events [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] Unable to find a host for instance a5773140-5308-4eaf-8557-2d9739c592ea. Dropping event network-vif-unplugged {{(pid=125410) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 03:36:52.074683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-19c5cf9d-4715-408d-98c4-3c3282d9182e req-42dc3511-104d-4225-97ef-ea33a6e69076 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030482 Nov 02 03:36:52.075526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 238/476] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 03:36:52.127520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:52.139754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-09cc81b4-8d8b-475e-a43f-867a88d26617 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/action" status: 202 len: 0 microversion: 2.20 time: 0.137886 Nov 02 03:36:52.140401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 239/477] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Nov 2 03:36:52 2022] POST /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:36:52.150928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:52.152240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:52.158895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.159700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.160159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.160859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.161846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.162275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.172460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:52.173388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:52.181676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.182176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.182724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.183497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:52.183990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:52.184584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:52.368662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:52.372944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:52.378686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:52.380744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:52.382210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3abd44ea-33ff-40ad-96e9-27122580ab1b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1750 microversion: 2.20 time: 0.235181 Nov 02 03:36:52.383177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2f2162b6-3a43-4754-90c2-6c1bf7f6debc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.215990 Nov 02 03:36:52.383821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 240/478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:36:52.388313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 239/479] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:53.407819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:53.408297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:53.408665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:53.408769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:53.415069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:53.415498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:53.415865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:53.416282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:53.416426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:53.416724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:53.417024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:53.417422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:53.417525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:53.417873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:53.418003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:53.418332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:53.615211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:53.618349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:53.623526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-08a6fe9f-00af-44a4-9d8f-fba7d896cb46 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.220216 Nov 02 03:36:53.624362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 241/480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:53.627554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:53.629041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:53.630201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3fe855f6-612a-406d-b1d5-4747bca0182a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.226325 Nov 02 03:36:53.630744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 240/481] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:54.647447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:54.648086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:54.650536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:54.654681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:54.655293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:54.655754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:54.656468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:54.656907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:54.657595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:54.657707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:36:54.657825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea (ip 10.222.0.26) !!! Nov 02 03:36:54.658040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:54.658785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=74 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:54.659417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:54.666259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:54.666748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:54.667185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:54.667891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:54.668373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:54.668797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:54.856132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:54.862932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:54.864270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-326127d6-aebf-468d-b2b6-cd885909b503 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.221304 Nov 02 03:36:54.865028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 242/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:54.871718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:54.873189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:54.874603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-649e1b4d-369e-4315-9b24-4c64e761232a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.223724 Nov 02 03:36:54.875146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 241/483] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:55.890812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:55.891421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:55.898524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:55.899002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:55.899433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:55.900147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:55.900599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:55.901019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:55.901691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:55.902302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:55.908944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:55.909447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:55.909882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:55.910604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:55.911049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:55.911986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:56.295561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:56.302144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:56.305136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0d0a7f5d-db4f-4c44-a2dc-99d73345b934 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1723 microversion: 2.1 time: 0.417980 Nov 02 03:36:56.305718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 243/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:56.312759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:56.314211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:56.315359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7ed0c7c6-5bfc-4645-b78f-ae4d118020c2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.417659 Nov 02 03:36:56.315940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 242/485] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:57.328595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:57.329208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:57.335146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.335655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.336120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.336811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.337274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.337697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.342005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:57.342621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:57.349709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.350187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.350684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.351396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.351854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.352305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.529126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:57.533368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:57.538760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-459c166e-4090-430c-aa5a-f3fc90bb057f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1700 microversion: 2.1 time: 0.214086 Nov 02 03:36:57.539332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 244/486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1700 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:57.542913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:57.544477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:57.545727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2f853c6b-9f7e-4a78-a5a2-40daa95a2d97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.207599 Nov 02 03:36:57.546354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 243/487] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:36:57.561517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:36:57.567718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.568237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.568684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.589938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Going to try to start instance {{(pid=125411) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 03:36:57.630749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0e883048-0048-438c-9fa4-f4e2cab3eae0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action" status: 202 len: 0 microversion: 2.1 time: 0.072318 Nov 02 03:36:57.631336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 245/488] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:36:57 2022] POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:36:57.639405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:57.640068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:57.646795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.647320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.648009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.648868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:57.649464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:57.649929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:57.783906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:57.795083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-edbb518e-f2f4-41a0-bc06-f6bd3a079b7d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1709 microversion: 2.1 time: 0.159355 Nov 02 03:36:57.795820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 244/489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:58.572444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:58.573192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:58.579505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:58.580039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:58.580509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:58.581223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:58.581697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:58.582139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:58.709952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:58.718805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:58.720362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:58.721585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d7acd22f-8ad4-4ac2-a36c-01483bd9c8e1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154593 Nov 02 03:36:58.722174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 246/490] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:36:58.823776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:58.824442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:58.830956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:58.831436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:58.831870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:58.832595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:58.833623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:58.834062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:58.970241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:58.978873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-801a26fe-faec-4d38-a546-36d9e16630cd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1709 microversion: 2.1 time: 0.158947 Nov 02 03:36:58.979430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 245/491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:36:59.748268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:36:59.748813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:36:59.755503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:59.756016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:59.756462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:59.757162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:36:59.757620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:36:59.758049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:36:59.884461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:59.892925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:59.894372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:36:59.896094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d40ab746-407d-43c2-8634-ed305064118c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151256 Nov 02 03:36:59.896651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 247/492] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:36:59 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:00.002655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:00.003193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:00.010061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:00.010534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:00.010963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:00.011641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:00.012129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:00.012545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:00.141543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:00.149783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9f768a3c-0de3-406f-907d-fc9615260a1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1713 microversion: 2.1 time: 0.151275 Nov 02 03:37:00.150345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 246/493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:36:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:37:00.921884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:00.922433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:00.929060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:00.929561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:00.929997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:00.930710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:00.931181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:00.931621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:01.068316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:01.076783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:01.078240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:01.079364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f6045f98-2bea-4edb-b723-b66405a881e0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.161686 Nov 02 03:37:01.079925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 248/494] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:02.104742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:02.105357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:02.111971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:02.112458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:02.112895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:02.113590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:02.114041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:02.114465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:02.242175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:02.251375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:02.252916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:02.254091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d1e9d515-ae19-42c1-80df-94aa6b6c491e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.153227 Nov 02 03:37:02.254715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 247/495] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:03.281368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:03.281913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:03.288819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:03.289299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:03.289740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:03.290430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:03.290891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:03.291319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:03.426430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:03.435025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:03.436488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:03.437633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5127cca9-98f8-4f1a-a7fe-1c13e178ba65 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.160826 Nov 02 03:37:03.438252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 249/496] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:03 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:04.466999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:04.467773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:04.475700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:04.476258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:04.476904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:04.477716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:04.478373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:04.478922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:04.611921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:04.620897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:04.622315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:04.623458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51df4899-9ae8-4e2c-9426-178bfab83143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.161108 Nov 02 03:37:04.624023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 248/497] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:05.649154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:05.649770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:05.656192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:05.656680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:05.657121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:05.657814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:05.658281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:05.658712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:05.788935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:05.797452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:05.798883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:05.800047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a41894b2-93da-49b6-a460-9720d235d1f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155391 Nov 02 03:37:05.800600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 250/498] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:06.826430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:06.826991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:06.829557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:37:06.829713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea (ip 10.222.0.26) !!! Nov 02 03:37:06.836522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:06.837049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:06.837508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:06.838251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:06.838727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:06.839176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:06.966925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:06.976678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:06.978122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:06.979280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-28aa7498-95bf-494b-8409-d86d8df68cb8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.157018 Nov 02 03:37:06.979837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 249/499] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:08.005213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:08.005935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:08.012576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:08.013052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:08.013481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:08.014166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:08.014612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:08.015032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:08.139285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:08.148236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:08.149693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:08.150857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5965d192-3906-40bb-b102-bb865d7bcef5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149682 Nov 02 03:37:08.151405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 251/500] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:09.176989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:09.178068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:09.184313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:09.184791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:09.185227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:09.185916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:09.186366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:09.186788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:09.320252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:09.328789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:09.330231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:09.331377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4baf4089-5b9a-4473-809a-ecfeb5554d86 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.158780 Nov 02 03:37:09.331935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 250/501] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:10.356986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:10.357599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:10.363924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:10.364431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:10.364868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:10.365560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:10.366011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:10.366433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:10.492529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:10.501385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:10.502828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:10.504001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da579c74-ff7e-4ef0-9b3f-fe82c6cfe269 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150861 Nov 02 03:37:10.504621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 252/502] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:37:11.529521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:11.529951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:11.536861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:11.537346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:11.537782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:11.538480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:11.538927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:11.539346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:11.668543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:11.677710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:11.679150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:11.680351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d5a258f0-b576-4d18-ba55-d701385f4e3a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154904 Nov 02 03:37:11.680915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 251/503] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:12.705508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:12.706112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:12.712479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:12.712952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:12.713381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:12.714086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:12.714532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:12.714950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:12.843095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:12.851842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:12.853306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:12.854438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23348b48-7db1-4661-9216-0d3817d65d20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152854 Nov 02 03:37:12.854986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 253/504] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:13.881031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:13.881571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:13.887939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:13.888442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:13.888883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:13.889578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:13.890026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:13.890452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:14.019120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:14.028227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:14.029672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:14.030824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d7f8716e-5f0b-4230-91c3-c00828734e56 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154251 Nov 02 03:37:14.031394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 252/505] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:15.056412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:15.057029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:15.063336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:15.063813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:15.064283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:15.064968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:15.065420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:15.065845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:15.191401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:15.200504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:15.201926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:15.203055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6f712303-3195-4a2c-8a25-55fd88e6ded5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150974 Nov 02 03:37:15.203621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 254/506] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:16.228017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:16.228653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:16.234954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:16.235448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:16.235878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:16.236580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:16.237027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:16.237457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:16.241476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:16.367600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:16.376356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:16.377818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:16.378951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e1f79739-2c14-41c1-9b5e-483f52acf4d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154820 Nov 02 03:37:16.379499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 253/507] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:17.404172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:17.404779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:17.411153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:17.412275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:17.412714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:17.413395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:17.413842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:17.414261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:17.436263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:17.547939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:17.556928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:17.558345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:17.559486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-56a7988e-9fdb-4353-8242-ab44779a2526 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.159359 Nov 02 03:37:17.560054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 255/508] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:18.585551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:18.586184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:18.592560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:18.593044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:18.593477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:18.594160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:18.594611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:18.595034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:18.720542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:18.729723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:18.731148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:18.732327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d6262bb2-3a9f-4a23-bfc1-4c137cdb09d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151273 Nov 02 03:37:18.732895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 254/509] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:19.758005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:19.758544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:19.764918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:19.765387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:19.765820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:19.766492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:19.766936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:19.767359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:19.894367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:19.902932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:19.904383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:19.905518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5c0ccf23-e74a-4873-8e13-e7e4f953b121 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151481 Nov 02 03:37:19.906074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 256/510] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:20.930625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:20.931168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:20.937890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:20.938364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:20.938795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:20.939476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:20.939923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:20.940367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:21.064863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:21.073210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:21.074639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:21.075817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ede2ca9e-de43-48b9-92f6-6cfbbb3e8afe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149154 Nov 02 03:37:21.076395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 255/511] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:22.101230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:22.101832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:22.108407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:22.108882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:22.109311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:22.109990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:22.110436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:22.110856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:22.238432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:22.247193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:22.248660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:22.250059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-381f68ea-fa6b-45cb-bdb9-546804b84302 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152700 Nov 02 03:37:22.250602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 257/512] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:23.275427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:23.276070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:23.282495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:23.282978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:23.283416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:23.284148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:23.284603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:23.285058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:23.414085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:23.422694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:23.424135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:23.425274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8119946b-2d86-47d7-b2ce-9e6505ad13d0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.153755 Nov 02 03:37:23.425828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 256/513] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:24.450622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:24.451150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:24.457376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:24.457867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:24.458899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:24.459599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:24.460084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:24.460518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:24.585464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:24.594186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:24.595656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:24.596858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bd102446-a26b-4176-836f-3423354f3d6d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150152 Nov 02 03:37:24.597433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 258/514] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:25.622908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:25.623446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:25.625560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=32 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:25.631175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:25.631655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:25.632115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:25.632793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:25.633238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:25.633654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:25.763530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:25.772601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:25.774119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:25.775256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-621b6826-73e5-48b0-a155-85d80715acce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156470 Nov 02 03:37:25.775863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 257/515] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:26.804647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:26.805196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:26.807471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=34 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:26.813198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:26.813680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:26.814116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:26.814805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:26.815256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:26.815689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:26.942924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:26.951472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:26.952951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:26.954106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0e40719c-c19e-4d41-bace-3f42d1e6b2af tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154055 Nov 02 03:37:26.954661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 259/516] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:27.403855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:27.404463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:27.410674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.411148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.411576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.412288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.412736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.413187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.436033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dfe46fe7-bf89-44c1-8d47-eb44d23b977f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/ips" status: 200 len: 149 microversion: 2.1 time: 0.035951 Nov 02 03:37:27.436583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 258/517] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:37:27 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:27.449378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ddbcc7-42b3-4d2a-b510-d9199c40d255"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:37:27.451758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:27.457603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.458080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.459099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.459780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.460254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.460675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.538195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: POST /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/os-volume_attachments HTTP/1.1 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 74 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:37:27.540217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {"volumeAttachment": {"volumeId": "19ddbcc7-42b3-4d2a-b510-d9199c40d255"}} Nov 02 03:37:27.541785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'server_id': '462d4a05-6687-47b8-b2c9-942b76d76274', 'body': {'volumeAttachment': {'volumeId': '19ddbcc7-42b3-4d2a-b510-d9199c40d255'}}} Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:37:27.542685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:27.543895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 400 to user: Invalid volume: volume 19ddbcc7-42b3-4d2a-b510-d9199c40d255 is already attached to instances: 9436aec2-8b2e-443f-a1c7-21a459f4bafa {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4b2c97ed-663d-4e4b-b837-8d6536c7c760 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096436 Nov 02 03:37:27.545080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 260/518] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 03:37:27 2022] POST /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 03:37:27.550699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:27.551190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:27.557078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.557549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.557979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.558650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.559093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.559503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.585934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:37:27.668131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-00e290ea-d227-4860-8f6a-cda4d8a40ee7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 204 len: 0 microversion: 2.1 time: 0.120746 Nov 02 03:37:27.668616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 259/519] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:37:27 2022] DELETE /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:37:27.677609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:27.678308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:27.685392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.685879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.686314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.687009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.687462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.687889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.814643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:27.822262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-277c9271-0e56-4d7a-8050-0e02da56885a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1681 microversion: 2.1 time: 0.149240 Nov 02 03:37:27.822823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 261/520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:37:27 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:37:27.981299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:27.982018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:27.987775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.988280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.988820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:27.989524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:27.989967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:27.990385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:28.114411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:28.122824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:28.124531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:28.125672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8b9b616-de98-4964-941b-94ec01f6704d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148807 Nov 02 03:37:28.126217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 260/521] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:28.845241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:28.845784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:28.852826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:28.853313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:28.853753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:28.854449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:28.854905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:28.855333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:28.991887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:29.000060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-74babbc9-77a5-4e94-af3a-891aa6a0b9f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1681 microversion: 2.1 time: 0.158698 Nov 02 03:37:29.000618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 262/522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:37:28 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:37:29.151147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:29.151682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:29.158021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:29.158501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:29.158933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:29.159619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:29.160112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:29.160538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:29.289937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:29.298495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:29.299924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:29.301090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c78a26c2-f5d7-4954-939b-d0f531ed2d25 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.153924 Nov 02 03:37:29.301639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 261/523] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:37:30.024146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:30.024897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:30.031547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:30.032201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:30.032755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:30.033540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:30.034098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:30.034609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:30.168745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:30.176394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6ad25be7-5568-401c-b1d5-52386443068a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1681 microversion: 2.1 time: 0.157011 Nov 02 03:37:30.177486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 263/524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:37:30 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:37:30.326222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:30.326758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:30.333990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:30.334557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:30.335208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:30.336039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:30.336515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:30.336944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:30.472618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:30.481837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:30.483366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:30.484666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1fe833a8-8227-4c55-9ffd-a3fdaab0762f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.162454 Nov 02 03:37:30.485305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 262/525] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:30.560090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462d4a05-6687-47b8-b2c9-942b76d76274", "name": "network-vif-deleted", "tag": "1489ae3e-0675-40a6-9bd0-e6cba2ef51f5"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:37:30.575329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:30.576094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:30.576784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:30.601919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] Creating event network-vif-deleted:1489ae3e-0675-40a6-9bd0-e6cba2ef51f5 for instance 462d4a05-6687-47b8-b2c9-942b76d76274 on hv-cinder-86020 Nov 02 03:37:30.607194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-2e7938c4-0bf9-40f7-8205-8d0de7253d9c req-1d876a85-d331-4960-abb3-7d72a838a6f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050980 Nov 02 03:37:30.607797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 264/526] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:31.200523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:31.201477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:31.207834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:31.209139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:31.209582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:31.210287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:31.210739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:31.211456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:31.243759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:31.244283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:31.244723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:31.245173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lazy-loading 'fault' on Instance uuid 462d4a05-6687-47b8-b2c9-942b76d76274 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:37:31.290891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:31.299036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7185b8f5-83cf-4996-a90d-8f0f43acff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 200 len: 1331 microversion: 2.1 time: 0.102276 Nov 02 03:37:31.299770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 263/527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:37:31 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:37:31.512324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:31.513707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:31.520301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:31.521787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:31.522579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:31.523737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:31.524796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:31.525538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:31.678478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:31.687477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:31.689749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:31.691130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5548af9e-e020-4c70-9222-f03709c923a7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.184891 Nov 02 03:37:31.696119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 265/528] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:32.324876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:32.325485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:32.331870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:32.332377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:32.332811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:32.333997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:32.334447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:32.334865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:32.349674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 HTTP/1.1 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:37:32.351321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 03:37:32.352810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '462d4a05-6687-47b8-b2c9-942b76d76274'} Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:37:32.353706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 03:37:32.355231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:37:32.356605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:37:32.356605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-558e759d-bc00-43bf-866f-fb0638b067e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 404 len: 111 microversion: 2.1 time: 0.031769 Nov 02 03:37:32.356605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 264/529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:37:32 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:37:32.361582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67034626-5026-4369-9197-a3e1ff137890 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '.version_select at 0x7f5c924139d0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:32.382637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67034626-5026-4369-9197-a3e1ff137890 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666293079" status: 202 len: 0 microversion: 2.1 time: 0.024685 Nov 02 03:37:32.383160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 266/530] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 03:37:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666293079 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:37:32.719836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:32.720486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:32.727247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:32.727734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:32.728203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:32.728909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:32.729424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:32.729848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:32.870280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:32.879201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:32.880695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:32.881863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c1057319-5958-4678-bc3b-0a31c65ccbec tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.166361 Nov 02 03:37:32.882416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 265/531] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:33.061550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:33.062064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:33.068724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.069212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.069654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:33.070479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.070946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.071379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:33.192174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lazy-loading 'services' on Instance uuid 9436aec2-8b2e-443f-a1c7-21a459f4bafa {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:37:33.309225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23d7b770-518d-46b8-9151-5ffac29ad66a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments/19ddbcc7-42b3-4d2a-b510-d9199c40d255" status: 202 len: 0 microversion: 2.1 time: 0.252266 Nov 02 03:37:33.309828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 267/532] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 03:37:33 2022] DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments/19ddbcc7-42b3-4d2a-b510-d9199c40d255 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:37:33.318140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:33.320470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:33.326350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.326914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.327310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:33.328017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.328626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.329202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:33.358901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-32612d4c-323a-473f-8707-d657524dff1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Nov 02 03:37:33.359472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 266/533] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:37:33.913836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:33.914530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:33.920760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.921240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.921675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:33.922352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:33.922802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:33.923223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:34.054614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:34.063144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:34.064599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:34.065744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-164d2d59-de67-4fcb-a1a3-55b774b94d60 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156292 Nov 02 03:37:34.066293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 268/534] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:34.371571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:34.373794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:34.380426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:34.380907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:34.381378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:34.382060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:34.382542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:34.382962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:34.413232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-615e34f2-b254-4d13-a27a-e94c6d27dce3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Nov 02 03:37:34.413787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 267/535] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:35.090546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:35.091152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:35.097496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:35.097987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:35.098409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:35.099597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:35.100075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:35.100497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:35.229902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:35.238586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:35.240058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:35.241211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-26faa36e-18d9-4459-972a-616e46b46935 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154552 Nov 02 03:37:35.241769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 269/536] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:35.425708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:35.428423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:35.434776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:35.435254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:35.435685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:35.436398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:35.436844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:35.437264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:35.462265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:35.467496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8b6a0620-c39b-442e-b0a5-aec7449901f7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Nov 02 03:37:35.468083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 268/537] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:36.266331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:36.266940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:36.274003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:36.274519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:36.274956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:36.275655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:36.276153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:36.276581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:36.407983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:36.416749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:36.418215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:36.419373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a3f0fd4-9792-412f-a97d-bf35af2a610f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156909 Nov 02 03:37:36.419927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 270/538] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:37:36.481290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:36.483423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:36.491358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:36.491867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:36.492325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:36.493002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:36.493450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:36.493870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:36.523228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-35254add-de4b-442d-97ab-d6c7cff25053 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046885 Nov 02 03:37:36.523793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 269/539] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:37.444645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:37.446337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:37.452708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:37.453195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:37.453639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:37.454345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:37.454813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:37.455240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:37.535151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:37.537502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:37.544068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:37.544551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:37.544985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:37.545681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:37.546129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:37.546556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:37.577163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e5b04d96-5eca-4614-9af2-9acd059e2a55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Nov 02 03:37:37.577726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 270/540] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:37:37.585600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:37.594168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:37.595622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:37.596796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d7e41fe5-108f-40bb-b2cb-383e66a93bae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156924 Nov 02 03:37:37.597353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 271/541] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:38.176843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:38.177351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:38.183170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.183647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.184118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.184805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.185258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.185681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.309896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lazy-loading 'services' on Instance uuid 68620f31-6b17-41c5-9c0f-48ac66097f04 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:37:38.436944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-25a18150-4090-443c-8643-171b30a5124c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments/56db1ca3-5e28-4aee-b414-88c9dbf61785" status: 202 len: 0 microversion: 2.1 time: 0.263999 Nov 02 03:37:38.437523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 271/542] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 03:37:38 2022] DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments/56db1ca3-5e28-4aee-b414-88c9dbf61785 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:37:38.589475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:38.591722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:38.598078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.599064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.599686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.600418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.600881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.601317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.623696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:38.624831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:38.631574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.631723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b4fb0bde-62cc-4e5e-9d9d-c026cf060980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046247 Nov 02 03:37:38.632074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.632262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:38.632504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.633263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:38.633716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:38.634136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:38.760414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:38.768877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:38.770297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:38.772049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0acf9b6f-9c0f-48eb-8406-e1d423166b3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.153196 Nov 02 03:37:38.772606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 272/544] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:37:39.643936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:39.646575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:39.652892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:39.653369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:39.653805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:39.654490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:39.654951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:39.655375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:39.659034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:39.687300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-214021c2-571a-4266-b1a0-e27879bce597 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047220 Nov 02 03:37:39.687852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 273/545] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:39.797327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:39.797862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:39.804228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:39.804711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:39.805142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:39.805818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:39.806260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:39.806677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:39.934472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:39.943496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:39.944933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:39.946065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d61f21aa-8558-4558-98aa-805db0533f89 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152733 Nov 02 03:37:39.946623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 273/546] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:39 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:40.699204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:40.701371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:40.707752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:40.708287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:40.708722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:40.709403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:40.709848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:40.710269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:40.739165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5e4e6239-cbbe-4e86-98a8-4d2d9f411fc3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Nov 02 03:37:40.739766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 274/547] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:40.971702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:40.972331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:40.978830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:40.979307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:40.979738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:40.980446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:40.980888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:40.981304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:41.107406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:41.116444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:41.117863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:41.118993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f4a5df7f-d474-42dd-82ea-c33fdacf52a9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151201 Nov 02 03:37:41.119548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 274/548] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:41.750900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:41.753134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:41.759987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:41.760477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:41.760913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:41.761597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:41.762046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:41.762468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:41.791811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6e476f8b-b2ed-417f-b5e9-b2a71ccfc057 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Nov 02 03:37:41.792392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 275/549] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:42.144324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:42.144926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:42.151937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:42.152440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:42.152872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:42.153553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:42.154007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:42.154428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:42.283859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:42.292427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:42.293863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:42.295019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d3c788c4-7e93-49fe-96d1-c658a92c1326 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154562 Nov 02 03:37:42.295616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 275/550] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:42.804110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:42.806234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:42.812609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:42.813096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:42.813530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:42.814217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:42.814666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:42.815124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:42.845308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-88e95594-a51a-4035-a9fb-1ddb1c197c4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Nov 02 03:37:42.845869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 276/551] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:43.322226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:43.322837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:43.329273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:43.329820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:43.330260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:43.330952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:43.331405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:43.331853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:43.461545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:43.471681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:43.473495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:43.474943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5cb1c72c-9134-4e18-860a-73d0fa848afc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156915 Nov 02 03:37:43.475764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 276/552] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:43.858124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:43.860320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:43.867214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:43.867641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:43.868105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:43.868802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:43.869254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:43.869676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:43.898985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-66ba4222-ba35-4e88-b057-c7f4a5b50f08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Nov 02 03:37:43.899546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 277/553] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:44.502129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:44.502743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:44.509883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:44.510544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:44.510990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:44.513895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:44.514360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:44.514788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:44.647417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:44.656118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:44.657489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:44.658789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f3746405-f326-4d15-9835-da5e37ce0b5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.161047 Nov 02 03:37:44.659782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 277/554] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:44.910886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:44.913066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:44.919311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:44.919782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:44.920249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:44.920926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:44.921373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:44.921789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:44.951088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-693e8b4a-a2a3-4246-921b-7d020c0b69c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Nov 02 03:37:44.951625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 278/555] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:45.685660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:45.686297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:45.692703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:45.693173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:45.693603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:45.694310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:45.694753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:45.695170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:45.822498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:45.830938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:45.832402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:45.834040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5c6a6c95-8c3d-4ee3-8794-f0799112e181 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152167 Nov 02 03:37:45.834598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 278/556] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:45.963104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:45.965454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:45.971761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:45.972277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:45.972804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:45.974130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:45.974589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:45.975014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:46.003979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1eeb637f-0848-48c6-b728-200b7d501b62 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Nov 02 03:37:46.005042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 279/557] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:46.859480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:46.860031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:46.866941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:46.867421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:46.867861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:46.868571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:46.869029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:46.869452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:46.999784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:47.009565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:47.016841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:47.018341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:47.020145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf7a15c2-6654-4aaf-a4a6-cea002cfd720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.162609 Nov 02 03:37:47.021021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 279/558] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:47.021777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:47.028247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:47.029337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:47.029857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:47.030613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:47.031129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:47.031616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:47.061056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5168f3dc-9a2e-4694-8142-cf06390cb5ef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Nov 02 03:37:47.061599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 280/559] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:48.046109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:48.046812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:48.053821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:48.054297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:48.054731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:48.055419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:48.055863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:48.056313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:48.074123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:48.076972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:48.083509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:48.084018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:48.084457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:48.085149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:48.085602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:48.086025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:48.115805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f7882b40-cda3-42d6-a624-bc0b72420bd7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Nov 02 03:37:48.116395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:37:48.185923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:48.194988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:48.196450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:48.197607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-108eb04f-963f-40ef-8477-7cfaec57e465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155334 Nov 02 03:37:48.198153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 280/561] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:49.128502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:49.131301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:49.137666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:49.138148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:49.138587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:49.139301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:49.139755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:49.140202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:49.169091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-80fc1b0f-bde9-4778-a6a5-ba19898eb43c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Nov 02 03:37:49.169636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:49.222505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:49.223140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:49.229666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:49.230150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:49.230590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:49.231280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:49.231733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:49.232181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:49.358203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:49.367127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:49.368597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:49.369744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0a07126a-fc81-4b0a-b5cd-43c6b8c302e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151170 Nov 02 03:37:49.370301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 281/563] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:50.181520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:50.183702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:50.189954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:50.190432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:50.190865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:50.191557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:50.192037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:50.192463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:50.221324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-77012f77-256d-4417-8651-ce20fd7edc91 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Nov 02 03:37:50.221870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 283/564] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:50.395938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:50.396527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:50.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:50.403444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:50.403882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:50.404584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:50.405031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:50.405453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:50.532962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:50.541466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:50.542888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:50.544053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-09a26fc9-4136-40e7-a3e8-49c2dc181be4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152511 Nov 02 03:37:50.544608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 282/565] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:51.234261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:51.236608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:51.243682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:51.244196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:51.244633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:51.245351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:51.245797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:51.246219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:51.274908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a77097f7-80f6-469f-bf54-83d401c6c974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Nov 02 03:37:51.275444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 284/566] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:51.569296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:51.569900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:51.576336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:51.576818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:51.577252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:51.577937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:51.578384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:51.578813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:51.701898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:51.710808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:51.712282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:51.713424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-20df5b1e-988a-421c-8205-1b9e22bd742b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148008 Nov 02 03:37:51.713983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 283/567] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:52.286595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:52.288623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:52.294906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:52.295388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:52.295819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:52.296537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:52.296981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:52.297397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:52.327474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da5fe7ac-4824-4f24-9ae7-91137c35ed9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Nov 02 03:37:52.328207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 285/568] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:52.739471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:52.740109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:52.746557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:52.747033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:52.747468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:52.748182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:52.748639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:52.749065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:52.879631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:52.883154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:52.889371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:52.890797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:52.891943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8bb2e961-ffa0-4557-a2e2-724fdfafe6e2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156990 Nov 02 03:37:52.892586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 284/569] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:53.338641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:53.341041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:53.347900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:53.348546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:53.349045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:53.349826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:53.350379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:53.350903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:53.381989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0efc6266-655a-472f-a6f8-1f8534eedc37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047251 Nov 02 03:37:53.382530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 286/570] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:53.919066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:53.920282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:53.927273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:53.927751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:53.928230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:53.928914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:53.929366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:53.929788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:54.058885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:54.068167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:54.069765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:54.070913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-869fa830-f7c2-45d5-8ef2-4e0d9dc715b0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156995 Nov 02 03:37:54.071462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 285/571] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:54.394065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:54.396831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:54.403230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:54.403704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:54.404165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:54.404845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:54.405296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:54.405712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:54.434664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-27c68714-8b97-4e47-805f-0fddaa679620 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Nov 02 03:37:54.435139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 287/572] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:55.095496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:55.096155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:55.102602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:55.103084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:55.103524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:55.104245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:55.104700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:55.105127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:55.228972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:55.237626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:55.239050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:55.240266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d4d2e79-b34a-4ff2-b91a-f5649145a512 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148575 Nov 02 03:37:55.240819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 286/573] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:55.447120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:55.449319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:55.455730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:55.456254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:55.456698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:55.457427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:55.457928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:55.458351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:55.487423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-255be97f-15ed-4d3e-9bbd-4513bb1e826a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Nov 02 03:37:55.488012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 288/574] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:56.265911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:56.266514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:56.269122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:56.274778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:56.275255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:56.275690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:56.276408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:56.276860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:56.277283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:56.408470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:56.417707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:56.419137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:56.420313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3ce9291d-7102-49f3-9451-b669ac6236b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.158300 Nov 02 03:37:56.420870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 287/575] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:56.500178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:56.502304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:56.509208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:56.509689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:56.510397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:56.510807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:56.511357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:56.511826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:56.539791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:56.543361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9b8bffd1-39a2-458d-8886-f5050a262386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047425 Nov 02 03:37:56.543926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 289/576] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:57.446291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:57.446821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:57.453195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:57.453681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:57.454121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:57.454811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:57.455261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:57.455682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:57.559409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:57.561894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:57.565278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:57.570222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:57.570821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:57.571269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:57.571991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:57.572629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:57.573057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:57.593388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:57.606555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:57.606555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:57.606555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-32d38499-a9a5-4098-8f0d-1a7c1d8de335 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.161867 Nov 02 03:37:57.606867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 288/577] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:57.609830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e757802b-ea99-45fc-be3e-17c1203b2680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055692 Nov 02 03:37:57.610387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 290/578] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:58.622659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:58.625247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:58.629579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:58.631071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:58.632388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:58.632876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:58.633312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:58.644491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:58.644491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:58.644491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:58.644723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:58.644723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:58.644723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:58.644723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:58.645015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:58.645015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:58.664607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-89615781-1831-4fe1-8c01-6128802601c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Nov 02 03:37:58.665777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 289/579] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:58.765965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:58.774715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:58.776178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:58.777335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5fd61116-308f-4737-a0d0-a997074dd32d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151734 Nov 02 03:37:58.777895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 291/580] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:37:59.676412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:59.678693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:59.685024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:59.685502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:59.685935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:59.686622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:59.687078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:59.687495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:59.718118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-16630291-82dc-43c7-912b-0077462fe5e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Nov 02 03:37:59.718712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 290/581] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:37:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:37:59.802604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:37:59.803123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:37:59.809454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:59.809929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:59.810359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:59.811038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:37:59.811485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:37:59.811899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:37:59.938503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:59.947378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:59.948831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:37:59.949972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b3f5bc64-e3c0-459d-89ea-ee6d7f478a20 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151323 Nov 02 03:37:59.950560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 292/582] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:37:59 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:00.730590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:00.732636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:00.738866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:00.739342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:00.739773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:00.740493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:00.740942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:00.741363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:00.772696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c19e1f8f-6cf6-49c7-a96c-b852861698d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Nov 02 03:38:00.773251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 291/583] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:00.975686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:00.976323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:00.982634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:00.983114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:00.983548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:00.984272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:00.984719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:00.985137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:01.109681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:01.118168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:01.119598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:01.120773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-113d97bb-6ce2-4aff-af64-d5f1c525b016 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149548 Nov 02 03:38:01.121325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 293/584] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:01.785019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:01.787751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:01.794122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:01.794596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:01.795025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:01.795704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:01.796179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:01.796595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:01.827185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-21b8905d-247c-48b0-8742-24808f161c0f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Nov 02 03:38:01.827689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 292/585] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:02.146459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:02.146994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:02.153390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:02.153875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:02.154312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:02.155005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:02.155460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:02.155894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:02.286698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:02.295186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:02.296652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:02.297791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2a08fce8-01b1-4416-916b-bdf559c43bd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155834 Nov 02 03:38:02.298337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 294/586] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:02.840256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:02.842614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:02.849159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:02.849633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:02.850064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:02.850747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:02.851190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:02.851616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:02.884354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-19105103-6530-43aa-8443-525ac7c4b117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048183 Nov 02 03:38:02.884910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 293/587] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:03.323715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:03.324359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:03.330672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:03.331150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:03.331588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:03.332303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:03.332757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:03.333185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:03.460042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:03.468680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:03.470113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:03.471259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48608383-79fd-47e1-946e-106526449c01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151426 Nov 02 03:38:03.471844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 295/588] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:03 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:03.896889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:03.899599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:03.905703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:03.906180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:03.906612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:03.907610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:03.907739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:03.908158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:03.937793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fe1853fc-a38f-45fc-baea-2f6dcda41ce2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Nov 02 03:38:03.938493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 294/589] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:04.497468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:04.498081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:04.505372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:04.505848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:04.506282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:04.506971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:04.507426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:04.507849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:04.637144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:04.645783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:04.647218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:04.648401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dd217eb4-e165-45b1-b2b1-2c19d79671e3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154882 Nov 02 03:38:04.648962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 296/590] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:04.950025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:04.952282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:04.959004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:04.959485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:04.959919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:04.960628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:04.961152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:04.961487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:04.990663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d2daba89-e3ba-4810-ad67-b8cf1aa37be4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Nov 02 03:38:04.991220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 295/591] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:05.673130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:05.673739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:05.680673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:05.681154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:05.681587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:05.682278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:05.682732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:05.683156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:05.807495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:05.815965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:05.817459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:05.818597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-79530c6a-a84a-4ada-b327-8ff408f7f869 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149389 Nov 02 03:38:05.819156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 297/592] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:06.002986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:06.005390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:06.012985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:06.013467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:06.013899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:06.014586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:06.015051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:06.015465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:06.046454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f40042df-477c-4816-8b93-0277b64036cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Nov 02 03:38:06.047178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 296/593] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:06.843999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:06.844600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:06.850920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:06.851404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:06.851839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:06.852568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:06.853021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:06.853447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:06.977513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:06.985967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:06.987403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:06.988581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84255c94-6d08-4b4e-b746-b99b399c621c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148540 Nov 02 03:38:06.989676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 298/594] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:07.058913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:07.061139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:07.067476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:07.068153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:07.068730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:07.069661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:07.070113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:07.070535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:07.100188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7ea1d1ca-00a1-457e-9606-e6f5f24da3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Nov 02 03:38:07.100896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 297/595] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:08.013954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:08.014570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:08.021508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:08.021981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:08.022410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:08.023088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:08.023534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:08.023974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:08.113197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:08.116246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:08.137463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:08.138234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:08.138672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:08.139373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:08.139819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:08.140453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:08.159006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:08.171434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:08.173133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:08.174659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-881fb4fb-e281-4d93-a092-dc853ec220d2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.164387 Nov 02 03:38:08.175784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 299/596] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:08.199476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-426c0607-3a67-45a0-a9bc-c1dd38adbdd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090831 Nov 02 03:38:08.200073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 298/597] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:09.204723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:09.205424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:09.212229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:09.212953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:09.213436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:09.213868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:09.214554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:09.214736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:09.221549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:09.222100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:09.222640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:09.224198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:09.224719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:09.225360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:09.228843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:09.229414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:09.256986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-37093a81-c1cd-4c46-83dd-355625447909 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Nov 02 03:38:09.257662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 299/598] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:09.358631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:09.367107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:09.368578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:09.369756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cc973b2b-9e69-4ca7-8fac-f6f871918c34 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.168895 Nov 02 03:38:09.370308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 300/599] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:10.269701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:10.271934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:10.279168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:10.279645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:10.280100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:10.280787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:10.281230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:10.281648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:10.312427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-410f19e0-0f28-447e-a480-0cbd970c5294 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Nov 02 03:38:10.312983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 300/600] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:10.395816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:10.396425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:10.402755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:10.403227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:10.403658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:10.404367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:10.404811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:10.405230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:10.530984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:10.539659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:10.541140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:10.542292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edf56848-85d3-43ac-822b-4b169998faf5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150821 Nov 02 03:38:10.542849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 301/601] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:11.327271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:11.329436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:11.335930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:11.338008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:11.338448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:11.339141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:11.339595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:11.340042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:11.359288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:11.372813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c8666eb1-fe77-4779-a819-066499c8a581 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Nov 02 03:38:11.373362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 301/602] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:11.567659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:11.568327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:11.574736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:11.575218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:11.575660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:11.576389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:11.576852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:11.577282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:11.701917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:11.710965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:11.712450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:11.713599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2d279477-07d0-4de4-bc51-1b51a63e3e6e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150387 Nov 02 03:38:11.714163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 302/603] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:12.385123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:12.387286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:12.393392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:12.393864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:12.394301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:12.395052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:12.395500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:12.395916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:12.425097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-25032dd7-f763-4644-8742-9490f7097bd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Nov 02 03:38:12.425634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 302/604] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:12.738785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:12.739391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:12.745806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:12.746285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:12.746720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:12.747401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:12.747851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:12.748298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:12.874075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:12.882722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:12.884192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:12.885343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a3f31566-7a85-425b-a808-03840be5a6d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150456 Nov 02 03:38:12.885889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 303/605] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:13.437312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:13.439485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:13.446693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:13.447184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:13.447619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:13.448344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:13.448800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:13.449267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:13.478552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8dd388b1-cb3b-4416-87fd-cc7c99d04632 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Nov 02 03:38:13.479100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 303/606] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:13.911290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:13.911900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:13.918360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:13.918842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:13.919285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:13.919988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:13.920443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:13.920866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:14.049752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:14.058767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:14.060227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:14.061373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d1aaffd5-e768-4754-9564-b60e15a1afa7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154525 Nov 02 03:38:14.061923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 304/607] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:14.490672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:14.492887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:14.499249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:14.500015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:14.500527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:14.501190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:14.501675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:14.502041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:14.532544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-63f2a3fa-3df6-4b4d-8991-e41747d3d2d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Nov 02 03:38:14.533100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 304/608] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:15.085581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:15.086199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:15.092490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:15.092970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:15.093414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:15.094101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:15.094559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:15.094985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:15.219090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:15.228215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:15.229669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:15.230836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7fa38064-d91c-49a7-a6cc-ff78f7d55006 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149194 Nov 02 03:38:15.231388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 305/609] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:15.544754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:15.546885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:15.553787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:15.554263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:15.554692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:15.555374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:15.555821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:15.556269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:15.586020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-25fb011b-2537-46a9-90a9-f8aa65075f29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Nov 02 03:38:15.586593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 305/610] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:16.257345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:16.257891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:16.264389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:16.264870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:16.265306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:16.265992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:16.266459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:16.266869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:16.288386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:16.401412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:16.409825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:16.411794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:16.412960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e770c62d-1b4c-4230-b1f0-bbddaa763886 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.159557 Nov 02 03:38:16.413514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 306/611] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:16.598893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:16.601045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:16.607702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:16.608209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:16.608643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:16.609314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:16.609752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:16.610167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:16.642712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9293b5aa-1abc-4bbb-a650-8ff3ead94410 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048301 Nov 02 03:38:16.643276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 306/612] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:17.438429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:17.438951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:17.445801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:17.446273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:17.446702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:17.447382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:17.447827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:17.448270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:17.573907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:17.582560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:17.584041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:17.585200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e53f8cb0-9674-4d4f-a7b2-d12a10d48087 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150728 Nov 02 03:38:17.585749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 307/613] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:17.655230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:17.657475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:17.664383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:17.664863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:17.665300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:17.665996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:17.666443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:17.666864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:17.696646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dc71b7c9-c473-44af-8b32-5950d25e0367 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Nov 02 03:38:17.697202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 307/614] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:18.610840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:18.611467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:18.618551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:18.619036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:18.619471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:18.620206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:18.620663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:18.621085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:18.711332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:18.714378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:18.721153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:18.721651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:18.722089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:18.722806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:18.723263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:18.723726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:18.760132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:18.760296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4f6fe84f-ed4e-49b6-b7b4-422bd0bbcdad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051960 Nov 02 03:38:18.761142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 308/615] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:18.769692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:18.771165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:18.772412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-870aec11-7f67-4bd5-985e-ac0e1f4fc2e7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.165583 Nov 02 03:38:18.772988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 308/616] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:19.771920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:19.774753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:19.781135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:19.781552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:19.781982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:19.782659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:19.783101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:19.783514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:19.797932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:19.798541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:19.804951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:19.805442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:19.805882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:19.806589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:19.807050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:19.807477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:19.813096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4333e716-64d4-46cb-8103-ff18f9874ff4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Nov 02 03:38:19.813660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 309/617] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:19.932678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:19.942054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:19.943505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:19.944694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dea80077-0fc6-47c5-bc19-0c0c36500ab4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.150594 Nov 02 03:38:19.945451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 309/618] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:20.825928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:20.828206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:20.834784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:20.835261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:20.835692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:20.836406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:20.836855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:20.837274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:20.866911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8274cbe-4ed0-4825-be54-b18096e3921d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Nov 02 03:38:20.867460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 310/619] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:20.970646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:20.971249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:20.978406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:20.978894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:20.979335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:20.980058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:20.980513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:20.980936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:21.107514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:21.116060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:21.117531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:21.118679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e4512c4f-916b-44e4-ae9b-4a07f9579be5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151908 Nov 02 03:38:21.119265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 310/620] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:21.878883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:21.881629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:21.887874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:21.888414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:21.888851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:21.889544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:21.889999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:21.890421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:21.919115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f8e321a9-1899-4c3d-80c6-d80823cd992d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Nov 02 03:38:21.919599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 311/621] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:22.143840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:22.144478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:22.150858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:22.151343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:22.151783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:22.152508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:22.152969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:22.153402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:22.332528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:22.341582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:22.343038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:22.344231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dcb25acc-a204-4b4f-8fa2-79eea84ccc41 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.204221 Nov 02 03:38:22.344796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 311/622] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:22.930979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:22.933493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:22.939738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:22.940239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:22.940671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:22.941360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:22.941802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:22.942222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:22.971660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ac3cb093-4807-48b5-8c00-98d45402fc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Nov 02 03:38:22.972244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 312/623] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:23.370358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:23.370907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:23.377573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:23.378079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:23.378511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:23.379193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:23.379641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:23.380761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:23.508604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:23.517394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:23.518877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:23.520054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb7d682b-7c8e-4937-ae2c-b336aad05654 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.153632 Nov 02 03:38:23.520662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 312/624] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:23.983127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:23.985291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:23.991178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:23.991661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:23.992188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:23.992824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:23.993271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:23.993690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:24.022798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ec3ca5f1-165d-4cdd-a58d-aaf8a7901d33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Nov 02 03:38:24.023348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 313/625] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:24.546235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:24.546967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:24.553390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:24.553743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:24.554178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:24.554864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:24.555310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:24.555726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:24.685040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:24.694298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:24.695742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:24.697191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-894ec073-026a-4318-91fe-4fba94e7caab tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155407 Nov 02 03:38:24.697815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 313/626] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:25.035190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:25.037950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:25.044408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:25.044921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:25.045351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:25.046040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:25.046514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:25.046905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:25.076121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1161d34d-d877-4fae-9f3a-08d524f96aef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Nov 02 03:38:25.076666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 314/627] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:25.722771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:25.723371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:25.729712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:25.730187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:25.730618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:25.731296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:25.731745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:25.732197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:25.857635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:25.866036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:25.867457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:25.868641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1954a402-4f1c-4dea-9a88-eef41e01a8ad tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149723 Nov 02 03:38:25.869193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 314/628] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:26.089759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:26.091980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:26.098217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:26.098695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:26.099124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:26.099813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:26.100287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:26.100715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:26.131677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5b0ff574-20fd-46a3-84f0-e8f3fb7bbddc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Nov 02 03:38:26.132252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 315/629] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:26.894225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:26.894740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:26.901081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:26.901555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:26.901990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:26.902669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:26.903117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:26.903535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:27.028839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:27.037224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:27.038816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:27.040154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fdeda915-fac9-4bfe-9f43-706054b87af0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149797 Nov 02 03:38:27.040703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 315/630] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:27.144034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:27.146259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:27.148612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=58 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:27.154174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:27.154493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:27.154929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:27.155624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:27.156113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:27.156540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:27.186162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-414bc701-0ef7-4652-9bb5-f5d63b5062b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Nov 02 03:38:27.186717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 316/631] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:28.065953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:28.066570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:28.068936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:28.074363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:28.074855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:28.075297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:28.076019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:28.076488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:28.076918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:28.199046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:28.202534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:28.205025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:28.210129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:28.210672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:28.211313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:28.212103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:28.212621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:28.213122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:28.214281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:28.215730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:28.216911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ee28d131-8da4-421d-8619-c07e4f94e6f9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.154983 Nov 02 03:38:28.217675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 316/632] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:28.244718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0a00f096-1e7b-48d9-9e8c-2efdd673172a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049684 Nov 02 03:38:28.245269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 317/633] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:29.242919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:29.243303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:29.250063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:29.250540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:29.250967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:29.251740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:29.252218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:29.252643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:29.257148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:29.259303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:29.265564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:29.266049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:29.266484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:29.267179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:29.267631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:29.268078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:29.272287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:29.301760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5be4847f-d4e5-45a2-97db-e76a8c255f44 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048672 Nov 02 03:38:29.302573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 318/634] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:29.382686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:29.391173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:29.392642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:29.393797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0a6bd9fe-0d05-40f5-8adf-c165f3123c1f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155277 Nov 02 03:38:29.394345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 317/635] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:30.314598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:30.316715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:30.322555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:30.323034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:30.323466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:30.324184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:30.324634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:30.325054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:30.354113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8ab2dc01-3904-4133-b3b2-f075b8e1640e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Nov 02 03:38:30.354665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 319/636] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:30.418851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:30.419470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:30.425998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:30.426484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:30.426926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:30.428935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:30.429612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:30.430142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:30.560192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:30.568883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:30.570360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:30.571539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ace562c8-de6e-45ec-8811-de553f15f966 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156617 Nov 02 03:38:30.572177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 318/637] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:31.366955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:31.369152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:31.375932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:31.376480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:31.376940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:31.377673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:31.378122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:31.378564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:31.408134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a4685426-258a-4902-a4cc-b3e48f4fd50e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Nov 02 03:38:31.412867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 320/638] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:31.596996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:31.597605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:31.603989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:31.604469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:31.604910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:31.605601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:31.606052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:31.606477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:31.743541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:31.752298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:31.753725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:31.754867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e07ca346-fc6f-4b8f-a9bc-4ae2017f223f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.161777 Nov 02 03:38:31.755415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 319/639] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:32.420882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:32.423027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:32.429620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:32.430090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:32.430527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:32.431219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:32.431673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:32.432136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:32.462415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b21a14c6-c716-47a3-a7f6-c1c58bb658ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045461 Nov 02 03:38:32.463008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 321/640] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:32.779731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:32.780372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:32.786749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:32.787229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:32.787663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:32.788397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:32.788852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:32.789277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:32.916135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:32.924735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:32.926227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:32.927384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1885b193-6fbf-4cdb-9716-e6e7d53c2c51 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151554 Nov 02 03:38:32.927942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 320/641] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:33.474814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:33.477446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:33.483841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:33.484392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:33.484772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:33.485450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:33.485897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:33.486526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:33.515908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3813147e-451b-4476-8a10-4525b021e679 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Nov 02 03:38:33.516493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 322/642] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:34.059573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:34.060248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:34.066109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:34.066590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:34.067030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:34.067718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:34.068204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:34.068638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:34.393345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:34.401836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:34.403290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:34.404473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-60070832-ecba-49c8-9507-e9923036ee9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.454930 Nov 02 03:38:34.405015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 321/643] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:34.528376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:34.530495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:34.536980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:34.537461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:34.537895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:34.538584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:34.539031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:34.539450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:34.569811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-493f9fc1-1299-40fc-a590-45c70220c3e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Nov 02 03:38:34.570369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 323/644] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:35.429476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:35.430094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:35.436497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:35.436987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:35.437424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:35.438112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:35.438575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:35.438985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:35.562229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:35.571143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:35.572612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:35.573753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-892d61b0-4e63-440f-85bd-1a7979dba1f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148254 Nov 02 03:38:35.574306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 322/645] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:35.581512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:35.583632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:35.590771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:35.591241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:35.591669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:35.592371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:35.592945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:35.593436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:35.622912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a6ee60c1-c61f-4b60-afb3-7f2c483aade1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Nov 02 03:38:35.623470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 324/646] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:36.599340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:36.599944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:36.606885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:36.607358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:36.607785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:36.608503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:36.608948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:36.609364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:36.613193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:36.634664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:36.636872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:36.643259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:36.643714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:36.644177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:36.644869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:36.645317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:36.645737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:36.677864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4ececd26-f7c5-45cb-b54c-f814dc9f691a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Nov 02 03:38:36.678615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 325/647] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:36.739850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:36.748685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:36.750375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:36.751517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e7a050a3-857a-4a91-b2b7-68fabaa18012 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.156102 Nov 02 03:38:36.752088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 323/648] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:37.689699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:37.691874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:37.698366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:37.698840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:37.699271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:37.699969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:37.700419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:37.700859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:37.729956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1f8461df-eab0-43c8-a288-0ada5b0b653a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Nov 02 03:38:37.730523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 326/649] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:37.776276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:37.776890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:37.783249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:37.783677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:37.784166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:37.784852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:37.785302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:37.785726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:37.912628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:37.921515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:37.922946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:37.924126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c4a7062d-85a8-496d-be02-e281975e056c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151734 Nov 02 03:38:37.924679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 324/650] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:38.742993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:38.745152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:38.751680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:38.752211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:38.752632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:38.753311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:38.753757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:38.754177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:38.783588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bac15d72-e981-43b7-821d-2d5722f8cb20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045191 Nov 02 03:38:38.784206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 327/651] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:38.950215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:38.950904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:38.957313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:38.957875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:38.958325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:38.959008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:38.959454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:38.959875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:39.087906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:39.096318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:39.097743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:39.098877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e6da552c-9320-4fc1-a74d-754ffadfbf64 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152420 Nov 02 03:38:39.099420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 325/652] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:39.796118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:39.798253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:39.804628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:39.805210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:39.805715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:39.806901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:39.807530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:39.808313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:39.839200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-37a7485e-47dc-4665-8d98-6afe1465a63d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Nov 02 03:38:39.839475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 328/653] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:40.124695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:40.125235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:40.131542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:40.132531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:40.132961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:40.133631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:40.134076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:40.134493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:40.258197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:40.266644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:40.268130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:40.269286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c7ba1608-790d-42c6-afb0-1955a9310c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148826 Nov 02 03:38:40.269823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 326/654] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:40.958207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:40.960457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:40.968304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:40.968891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:40.969365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:40.970092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:40.970552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:40.970979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:41.004470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3649c336-cf62-4544-bbf2-de07fd711884 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157485 Nov 02 03:38:41.005062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 329/655] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:41.294987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:41.295628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:41.302002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:41.302480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:41.302914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:41.303599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:41.304080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:41.304504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:41.434042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:41.443400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:41.445378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:41.446530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-85b7b05a-7be4-42f7-97fc-61e4d7eee047 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155394 Nov 02 03:38:41.447111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 327/656] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:42.016529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:42.018637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:42.024998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:42.025477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:42.025908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:42.026600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:42.027047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:42.027471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:42.057890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-399bd9eb-5086-4ed0-a99d-1bd3f3706166 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Nov 02 03:38:42.058474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 330/657] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:42.471346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:42.471974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:42.478301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:42.478781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:42.479216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:42.479895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:42.480373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:42.480794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:42.605114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:42.613862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:42.615389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:42.617113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6f7a2908-b5fe-4d2c-ba3d-d3de6d3cea67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.149576 Nov 02 03:38:42.617669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 328/658] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:43.071538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:43.073763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:43.079843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:43.080347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:43.080787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:43.081696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:43.081924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:43.082346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:43.111704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7b5f44a8-8b27-40f4-9154-220c0f9df756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Nov 02 03:38:43.112290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 331/659] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:43.642849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:43.643459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:43.650641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:43.651122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:43.651561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:43.652281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:43.652735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:43.653161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:43.776612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:43.785131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:43.786579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:43.787726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d0f665c2-d3ca-46c1-85e8-abfc01af363f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.148792 Nov 02 03:38:43.788320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 329/660] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:44.123680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:44.126263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:44.133169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:44.133645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:44.134076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:44.134773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:44.135219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:44.135653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:44.164534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-14e27b18-2849-4fe9-8d2a-3ceaf92b1dcf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Nov 02 03:38:44.165338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 332/661] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:44.812778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:44.813414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:44.819778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:44.820282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:44.820714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:44.821390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:44.821839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:44.822256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:44.949059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:44.957497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:44.958930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:44.960603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-308509c1-f7fa-4ae4-9bce-82591b3e6689 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151695 Nov 02 03:38:44.961169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 330/662] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:45.177006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:45.179356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:45.185851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:45.186363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:45.186800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:45.187492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:45.187944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:45.188388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:45.219436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-34015554-fe33-472a-a36b-a02f272a6827 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046523 Nov 02 03:38:45.220017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 333/663] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:45.986372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:45.987165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:45.994309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:45.994785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:45.995217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:45.995899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:45.996372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:45.996794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:46.122905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:46.131791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:46.133241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:46.134540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dc540e02-8f84-4979-82bb-9ef09547b9e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152069 Nov 02 03:38:46.135089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 331/664] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:46.234271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:46.236759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:46.244340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:46.244830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:46.245266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:46.245966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:46.246408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:46.246830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:46.287132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:46.293079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-847a6130-52f7-45d1-b0ae-bc1e0965d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064514 Nov 02 03:38:46.293633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 334/665] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:47.159010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:47.159618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:47.165952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:47.166430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:47.166860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:47.167577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:47.168058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:47.168512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:47.298805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:47.306360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:47.308134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:47.308790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:47.309420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:47.310787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fd86d393-0e5c-49fc-a33b-2b86afc7acbd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155659 Nov 02 03:38:47.311343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 332/666] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:47.316212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:47.316752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:47.317373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:47.318066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:47.318518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:47.318935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:47.350210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-88a1abf1-f694-43b7-9040-42e5f51a2f65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048824 Nov 02 03:38:47.350794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 335/667] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:48.342272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:48.342877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:48.349762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:48.350250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:48.350686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:48.351376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:48.351827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:48.352279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:48.362330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:48.364480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:48.370900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:48.371381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:48.371813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:48.372527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:48.372968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:48.373617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:48.405111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d428778b-f4b9-4147-948a-f22e2ea16e30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Nov 02 03:38:48.407481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 336/668] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:48.493832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:48.505466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:48.507433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:48.508625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68b30f06-2171-4fc3-8665-bf493faae3ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.170544 Nov 02 03:38:48.509169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 333/669] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:49.417483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:49.419542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:49.425978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:49.426455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:49.426888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:49.427566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:49.428035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:49.428962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:49.458521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93cee2d2-1e2f-401b-9124-e9477e9255c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Nov 02 03:38:49.458521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 337/670] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:49.534077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:49.534778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:49.544688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:49.544688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:49.544688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:49.544688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:49.544991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:49.544991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:49.670342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:49.679279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:49.680739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:49.681878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d081d870-b395-4a98-8a33-3099123ef9bc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.151797 Nov 02 03:38:49.682430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 334/671] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:50.470588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:50.472845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:50.480612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:50.481123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:50.481553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:50.482249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:50.482689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:50.483102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:50.513527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-86b10305-fb62-4e37-a954-e4c25b03e2ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047079 Nov 02 03:38:50.514085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 338/672] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:50.706737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:50.707342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:50.713797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:50.714325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:50.714778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:50.715476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:50.715932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:50.716383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:50.846185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:50.855164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:50.856648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:50.857809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-57ed9442-aa9f-42cc-a4f5-255e03f4ca71 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.155061 Nov 02 03:38:50.858372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 335/673] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:51.526449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:51.528685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:51.535429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:51.535917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:51.536390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:51.537096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:51.537613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:51.538626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:51.568451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e4033ead-0432-4dbd-83f7-5c5dc48017fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Nov 02 03:38:51.568935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 339/674] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:51.883300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:51.883839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:51.890340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:51.890816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:51.891255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:51.891940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:51.892418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:51.892838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:52.019324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:52.028774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:52.030217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:52.031363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7aa5cf04-c20d-48db-9ec2-35bcde107c1d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152535 Nov 02 03:38:52.031911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 336/675] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:52.579980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:52.582109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:52.588491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:52.588968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:52.589400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:52.590082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:52.590529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:52.590952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:52.621282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9a4b4dc3-3dc7-4b84-9664-1b47ea5228be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Nov 02 03:38:52.621832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 340/676] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:53.056849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:53.057451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:53.063382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:53.063859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:53.064409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:53.064982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:53.065429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:53.065849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:53.194264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:53.202845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:53.204305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:53.205457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fc22a711-23e1-4d97-89f2-1d744b12eebf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1752 microversion: 2.20 time: 0.152403 Nov 02 03:38:53.206007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 337/677] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:53.634460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:53.636710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:53.642987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:53.643464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:53.643893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:53.644610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:53.645058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:53.645480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:53.674966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d13660c7-5bf8-45fe-81e3-4e7ca494122a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Nov 02 03:38:53.675522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 341/678] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:54.232177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:54.232787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:54.239093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:54.239571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:54.240037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:54.241641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:54.242311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:54.242772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:54.372098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:54.380887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:54.382823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:54.383997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7797a405-83a7-46cb-b912-6feb33207ac1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155775 Nov 02 03:38:54.384565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 338/679] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:54.687377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:54.689587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:54.695973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:54.696470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:54.696901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:54.697607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:54.698053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:54.698473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:54.726729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-67ee3a03-56c8-4800-985b-4dadf30b1d50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Nov 02 03:38:54.727266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 342/680] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:55.409481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:55.410136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:55.417112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:55.417590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:55.418047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:55.418729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:55.419203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:55.419624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:55.546894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:55.550738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:55.556818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:55.558239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:55.559376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-17f2d403-8981-477e-a189-ae29add9971a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153763 Nov 02 03:38:55.559928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 339/681] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:55.738083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:55.740290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:55.747204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:55.747676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:55.748138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:55.748813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:55.749264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:55.749936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:55.778150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eabde735-fc66-4768-9809-97383a114085 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Nov 02 03:38:55.778687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 343/682] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:56.584474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:56.585746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:56.592083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:56.592569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:56.593004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:56.593690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:56.594143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:56.594570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:56.720140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:56.728589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:56.730012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:56.731146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9be25710-56a8-444a-9f3c-f0798e3f696f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150791 Nov 02 03:38:56.731698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 340/683] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:56.790187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:56.792436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:56.798696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:56.799171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:56.799602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:56.800327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:56.800778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:56.801198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:56.831061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ecbc5cfa-c1c2-40b7-9647-dc022c9f951b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Nov 02 03:38:56.831609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 344/684] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:57.756463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:57.757072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:57.762928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:57.763399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:57.763827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:57.764546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:57.764996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:57.765416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:57.842737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:57.845051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:57.847320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=58 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:57.853212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:57.853695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:57.854134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:57.854829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:57.855278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:57.855700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:57.885585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a8614f6b-1078-4051-9f88-67a6473ec7f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 Nov 02 03:38:57.886153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 345/685] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:38:57.890747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:57.899884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:57.901347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:57.902492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e3596270-2281-4295-ac50-330fb3993141 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150185 Nov 02 03:38:57.903039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 341/686] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:38:58.897992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:58.900178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:58.906500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:58.906969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:58.907400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:58.908101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:58.908546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:58.908961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:58.926819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:58.927451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:58.930353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:58.935585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:58.936096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:58.936539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:58.937241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:58.937696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:58.938126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:58.939545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6262e54f-ea35-4b36-aae8-70c509ea9f0c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Nov 02 03:38:58.940130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 346/687] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:38:59.080092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:59.089512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:59.090963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:38:59.092162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d52f5892-523c-480f-93ea-fa26139cf7bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.169182 Nov 02 03:38:59.092714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 342/688] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:38:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:38:59.951212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:38:59.953533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:38:59.959859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:59.960365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:59.960797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:59.961469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:38:59.961911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:38:59.962327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:38:59.991701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b7a6fdc0-a2b0-41b4-b5f8-04988fd3772f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Nov 02 03:38:59.992276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 347/689] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:38:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:00.118119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:00.119283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:00.125769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:00.126261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:00.126677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:00.127357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:00.127806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:00.128249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:00.252994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:00.261492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:00.262927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:00.264098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b99f3c97-f8ef-41d9-b577-cb74f2b0426f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150379 Nov 02 03:39:00.264664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 343/690] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:01.004319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:01.007033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:01.013579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:01.014059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:01.014495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:01.015173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:01.015625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:01.016080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:01.045098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-002b2c66-2bdb-48e4-a57d-948e9699de0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Nov 02 03:39:01.045644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 348/691] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:01.288939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:01.289478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:01.295932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:01.296433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:01.296864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:01.297544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:01.297992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:01.298411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:01.431706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:01.440209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:01.441624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:01.442756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f575439a-2201-42d0-b983-07b8f54f1e62 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157765 Nov 02 03:39:01.443325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 344/692] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:02.057395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:02.059661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:02.065999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:02.066470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:02.066896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:02.067580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:02.068050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:02.068475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:02.096969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-af6014a7-83a6-4b33-b2f9-ea93c6f77c39 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Nov 02 03:39:02.097508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 349/693] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:02.468116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:02.468725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:02.475257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:02.475726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:02.476196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:02.476872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:02.477317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:02.477736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:02.606713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:02.615815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:02.617280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:02.618427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-19fc5328-9db5-41d5-ad3b-aebf7da85b70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154150 Nov 02 03:39:02.619003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 345/694] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:03.110074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:03.112282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:03.119040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:03.119518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:03.119976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:03.120656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:03.121108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:03.121530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:03.151022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d5f7fb62-029e-41e1-9b9d-9545bf7101a9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Nov 02 03:39:03.151585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 350/695] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:03.644398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:03.645001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:03.651745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:03.652258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:03.652687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:03.653362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:03.653810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:03.654230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:03.778181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:03.786687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:03.788652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:03.789819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a016e4d5-3d76-450f-86c7-b4d5e7fd3684 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149318 Nov 02 03:39:03.790370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 346/696] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:03 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:04.162855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:04.165137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:04.171424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:04.171889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:04.172346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:04.173021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:04.173464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:04.173881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:04.189787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:04.203850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f5196935-0202-4691-b46d-a1b7320e78ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Nov 02 03:39:04.204443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 351/697] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:04.814926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:04.815506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:04.822358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:04.822840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:04.823280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:04.823981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:04.824439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:04.824866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:04.952584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:04.961535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:04.962966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:04.964144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-90822b1b-416c-4848-a473-5da861e96e83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153158 Nov 02 03:39:04.964705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 347/698] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:05.216473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:05.218711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:05.225166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:05.225627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:05.226066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:05.226763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:05.227214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:05.227641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:05.257452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b7bed39b-7253-44f0-a729-9ed44a345333 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Nov 02 03:39:05.257992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 352/699] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:05.989335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:05.989948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:05.996718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:05.997288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:05.997733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:05.998435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:05.998885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:05.999307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:06.124845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:06.134015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:06.135466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:06.136664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-46032875-9c94-42ff-a2b3-0a3ec8132f0c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151309 Nov 02 03:39:06.137227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 348/700] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:06.270101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:06.272300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:06.278769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:06.279247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:06.279687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:06.280424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:06.280882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:06.281307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:06.312526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b79830a0-a6f1-492c-9153-6ef32cfb780f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Nov 02 03:39:06.313184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 353/701] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:07.161721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:07.162351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:07.168725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:07.169198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:07.169627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:07.170307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:07.170751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:07.171164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:07.298079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:07.306913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:07.308553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:07.309692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2ef29277-bee7-4d68-90d7-f8d1d733e067 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151857 Nov 02 03:39:07.310241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 349/702] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:07.325495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:07.327614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:07.333875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:07.334348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:07.334778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:07.335455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:07.335896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:07.336341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:07.364559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-26e191ca-cc09-4f31-8b17-971bcbcfcc4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Nov 02 03:39:07.365104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 354/703] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:08.336031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:08.336632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:08.342956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:08.343432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:08.343863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:08.344575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:08.345022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:08.345440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:08.376888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:08.379062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:08.386099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:08.386582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:08.387016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:08.387706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:08.388180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:08.388609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:08.418325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-12bfbf2c-3f46-47ea-9299-03b584a10f60 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Nov 02 03:39:08.418916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 355/704] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:08.474285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:08.482897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:08.484402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:08.485599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a85fe5f1-2833-4940-a40f-6640b24a5c78 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154050 Nov 02 03:39:08.486178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 350/705] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:09.431163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:09.433328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:09.439857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:09.440373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:09.440812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:09.441493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:09.441946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:09.442367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:09.470695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4989da60-e770-4975-9437-292b976540e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Nov 02 03:39:09.471241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 356/706] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:09.510464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:09.511075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:09.517345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:09.517824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:09.518260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:09.518943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:09.519396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:09.519822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:09.658142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:09.670701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:09.672170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:09.673332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af24306a-2e07-46a1-bf8c-144df23d9cfe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.166715 Nov 02 03:39:09.673892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 351/707] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:10.483032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:10.485130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:10.491414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:10.492439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:10.492847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:10.493537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:10.493985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:10.494405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:10.523462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f3a9b87b-6e37-4a82-9a98-66824c718349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Nov 02 03:39:10.524032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 357/708] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:10.698721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:10.699452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:10.705898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:10.706371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:10.706799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:10.707481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:10.707926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:10.708366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:10.834825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:10.843967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:10.845390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:10.846523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1876ba35-2006-4d33-b754-c7ec16fe97ce tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152232 Nov 02 03:39:10.847073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 352/709] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:11.535841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:11.538127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:11.545211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:11.545692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:11.546132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:11.546820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:11.547274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:11.547700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:11.577316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e997329d-1550-4af6-aa1c-fa7e68a90c54 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Nov 02 03:39:11.577870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 358/710] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:11.870495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:11.871104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:11.877610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:11.878084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:11.878515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:11.879197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:11.879647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:11.880099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:12.006722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:12.015300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:12.016748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:12.017889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e6add78f-ef9d-4e54-9581-482de947fbdc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151278 Nov 02 03:39:12.018441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 353/711] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:12.590305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:12.592470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:12.598688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:12.599159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:12.599587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:12.600297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:12.600746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:12.601160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:12.631693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b2245cc5-a7f4-49b9-876f-f8ffe27635ce tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Nov 02 03:39:12.632263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 359/712] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:13.043331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:13.043887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:13.050323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:13.050804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:13.051245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:13.051937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:13.052419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:13.052846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:13.181896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:13.190406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:13.191849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:13.193038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f38f8143-24c0-4531-98aa-3b192bb29538 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153726 Nov 02 03:39:13.193595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 354/713] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:13.644064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:13.646257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:13.652574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:13.653048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:13.653483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:13.654164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:13.654613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:13.655030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:13.684343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf76d31d-ac5b-4968-a795-d971fb23882c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Nov 02 03:39:13.684884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 360/714] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:14.218364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:14.219005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:14.225352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:14.225832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:14.226267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:14.226956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:14.228012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:14.228442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:14.353969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:14.362430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:14.363803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:14.364980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bd919b6a-d6c4-4d5d-b21a-e6185fe38afb tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150437 Nov 02 03:39:14.365548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 355/715] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:14 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:14.697502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:14.699563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:14.705992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:14.706468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:14.706902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:14.707583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:14.708069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:14.708498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:14.737440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eb351ad0-c137-47b5-b1dc-638f4301b75b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Nov 02 03:39:14.737979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 361/716] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:15.390502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:15.391111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:15.397473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:15.397956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:15.398388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:15.399676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:15.400174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:15.400603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:15.421866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:15.532893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:15.541778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:15.543216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:15.544400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-15d4f51e-fa93-4729-a399-93a5fe38a589 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157728 Nov 02 03:39:15.544948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 356/717] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:15.749020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:15.751472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:15.757860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:15.758340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:15.758781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:15.759465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:15.759918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:15.760363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:15.789000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de8e2424-8b64-4c62-8ecf-6c9d8eb95b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Nov 02 03:39:15.789542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 362/718] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:16.569848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:16.570506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:16.577597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:16.578078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:16.578514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:16.579197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:16.579646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:16.580099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:16.705547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:16.713943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:16.715593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:16.716759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1fb7a8f6-0e10-494f-8618-c440874d07a0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150783 Nov 02 03:39:16.717313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 357/719] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:16.801950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:16.804095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:16.811042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:16.811519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:16.811973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:16.812671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:16.813132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:16.813557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:16.841987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8248482f-65a2-43a3-94d1-03c69319523d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Nov 02 03:39:16.842542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 363/720] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:17.742607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:17.743237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:17.749773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:17.750250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:17.750680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:17.751355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:17.751801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:17.752251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:17.855122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:17.857339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:17.863636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:17.864162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:17.864604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:17.865305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:17.865761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:17.866188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:17.877878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:17.886456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:17.887882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:17.889065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a46df890-6641-43c7-9461-b1333696af01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150361 Nov 02 03:39:17.889643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 358/721] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:17.895345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-546e56e5-8b27-4c4e-87d6-9de2b2e7457a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Nov 02 03:39:17.895904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 364/722] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:18.908145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:18.910378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:18.915321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:18.915935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:18.917322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:18.917814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:18.918246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:18.918938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:18.919390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:18.919817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:18.922206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:18.922686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:18.923126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:18.923817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:18.924297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:18.924721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:18.949086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-88346aa1-90e6-4572-bb68-726e17e49484 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Nov 02 03:39:18.953862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 359/723] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:19.110310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:19.120444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:19.122269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:19.123515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-95cc15c9-1702-4d84-b4a4-73a780a6ab43 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.212646 Nov 02 03:39:19.124109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 365/724] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:39:19.962374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:19.964601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:19.970895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:19.971367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:19.971795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:19.972506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:19.972954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:19.973373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:20.002224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9cd5d1ff-a923-4d66-9d84-3dbcb978d8be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Nov 02 03:39:20.002757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 360/725] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:20.152190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:20.152784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:20.159025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:20.159511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:20.159963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:20.160661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:20.161112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:20.161537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:20.291481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:20.300098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:20.301531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:20.302678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-94b10ce9-fcb3-4088-992f-675415f1e773 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154386 Nov 02 03:39:20.303240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 366/726] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:21.014566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:21.016671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:21.022976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:21.023449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:21.024419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:21.025109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:21.025559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:21.025992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:21.056195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-29b88474-e239-44fd-9aa4-bb8f74297cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Nov 02 03:39:21.056750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 361/727] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:21.329179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:21.330413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:21.337042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:21.337519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:21.337952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:21.338637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:21.339142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:21.339559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:21.468641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:21.477732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:21.479173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:21.480359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-68a48626-b803-40d5-8280-6e64ea810f3e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155295 Nov 02 03:39:21.480915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 367/728] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:22.068638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:22.070796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:22.077175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:22.077650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:22.078089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:22.078785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:22.079238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:22.079665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:22.108309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce4f7a15-7d5a-45a7-bfa0-9c70445e27fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Nov 02 03:39:22.108848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 362/729] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:22.506627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:22.507226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:22.514170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:22.514638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:22.515068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:22.515742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:22.516209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:22.516630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:22.520539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:22.645065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:22.653492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:22.654910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:22.656124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8e45c899-b545-4a38-b643-1bd923f98ac8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153258 Nov 02 03:39:22.656682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 368/730] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:23.120276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:23.122407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:23.129069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:23.129549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:23.129988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:23.130700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:23.131179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:23.131600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:23.160525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ad3ad27-33ed-4762-9f5c-0e6622e22b6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Nov 02 03:39:23.161067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 363/731] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:23.683507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:23.684074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:23.690353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:23.690824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:23.691255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:23.691932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:23.692393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:23.692810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:23.821730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:23.830094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:23.831500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:23.832667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9416ad95-90b8-4ec5-a142-3db2047d98be tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153100 Nov 02 03:39:23.833224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 369/732] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:24.173390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:24.175540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:24.182448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:24.182942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:24.183375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:24.184084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:24.184530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:24.184947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:24.213391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0fa6ac15-5485-4778-a6a6-2359fc6e50b6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Nov 02 03:39:24.213940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 364/733] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:24.857475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:24.858093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:24.864523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:24.865004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:24.865442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:24.866137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:24.866588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:24.867016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:24.991075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:24.999787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:25.001295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:25.002451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5cc71553-a204-4eb8-a44e-edd6c02b15e9 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.148837 Nov 02 03:39:25.003006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 370/734] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:25.225656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:25.227772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:25.234036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:25.234513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:25.234942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:25.235617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:25.236093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:25.236516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:25.266017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d65d8bb6-246e-41e9-a8de-c4af3e185ae9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Nov 02 03:39:25.266546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 365/735] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:26.028028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:26.028632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:26.034839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:26.035307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:26.035732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:26.036436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:26.036897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:26.037297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:26.165654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:26.174103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:26.175673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:26.176841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-52874af7-755a-469d-9e36-788046d6f0ee tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152778 Nov 02 03:39:26.177390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 371/736] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:26.278641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:26.280761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:26.287072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:26.287550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:26.288015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:26.288701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:26.289154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:26.290159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:26.320954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d23a84c8-40d9-489a-9297-4dfa3538259b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Nov 02 03:39:26.321504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 366/737] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:27.202421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:27.203029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:27.209448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:27.209923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:27.210356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:27.211100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:27.212113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:27.212532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:27.333336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:27.335834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:27.341791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:27.342534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:27.343013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:27.343446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:27.344164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:27.344763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:27.345191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:27.350183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:27.351605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:27.352765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8d04b1fb-8527-4c2f-9d4e-e7fadc4ba644 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154285 Nov 02 03:39:27.353314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 372/738] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:27.374238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-25c3e8e9-96f4-4e57-8714-17668da2a666 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Nov 02 03:39:27.375041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 367/739] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:28.377964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:28.378566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:28.380885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=56 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:28.386064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:28.386542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:28.386981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:28.387122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:28.387671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:28.388146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:28.388568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:28.389184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:28.395509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:28.396002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:28.396442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:28.397125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:28.397568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:28.397983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:28.428894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6577a700-c235-47f4-b044-54906c610161 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Nov 02 03:39:28.429260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 368/740] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:28.515305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:28.524269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:28.525702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:28.526853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a01cca72-36c5-4703-b9c9-d66236c738ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153036 Nov 02 03:39:28.527407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 373/741] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:29.441111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:29.443262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:29.446066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=54 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:29.451360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:29.451839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:29.452307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:29.453008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:29.453464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:29.453891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:29.482994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c86f05e0-b2cc-4eeb-87e6-2573f80d67d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Nov 02 03:39:29.483532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 369/742] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:29.553611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:29.554423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:29.561614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:29.562158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:29.562592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:29.563427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:29.563889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:29.564410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:29.698076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:29.706704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:29.708186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:29.709342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de29ffdb-30e9-4616-8447-d61dcd158b1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.160162 Nov 02 03:39:29.709893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 374/743] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:30.494793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:30.496925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:30.503555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:30.504074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:30.504519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:30.505208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:30.505669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:30.506099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:30.536026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e82b892f-2334-4678-8011-70829b7b95b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Nov 02 03:39:30.536589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 370/744] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:30.734500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:30.735210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:30.741472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:30.741947 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:30.742378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:30.743059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:30.743508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:30.743922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:30.873187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:30.881910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:30.883914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:30.885067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-802c7422-33c7-44bf-b31f-0c6f5aec440c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154430 Nov 02 03:39:30.885619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 375/745] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:31.549352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:31.551527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:31.558438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:31.558923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:31.559358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:31.560089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:31.560546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:31.560969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:31.590745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f26ff10e-da86-451c-a567-852828407fdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Nov 02 03:39:31.591224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 371/746] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:31.911825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:31.912528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:31.919266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:31.919745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:31.920241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:31.920955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:31.921399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:31.921865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:32.051089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:32.061156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:32.062586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:32.063732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-97edee13-60d0-4bd5-82f0-e6c1a4b926d8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155857 Nov 02 03:39:32.064318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 376/747] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:32.602957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:32.605133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:32.612283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:32.612762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:32.613195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:32.613876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:32.614321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:32.614740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:32.645464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b6c35a61-066a-47fd-9a39-b8041c7df311 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Nov 02 03:39:32.646011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 372/748] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:33.089295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:33.090027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:33.096241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:33.096714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:33.097143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:33.097822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:33.098264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:33.098701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:33.227440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:33.235989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:33.237393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:33.238533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2f7e5b64-f8a5-4279-8d37-cf57afe4e6f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153134 Nov 02 03:39:33.239095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 377/749] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:33.657657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:33.659799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:33.666642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:33.667115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:33.667548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:33.668257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:33.668704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:33.669151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:33.672762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:33.698013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-76060f3f-0e40-468d-96cc-625a7b7aa121 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Nov 02 03:39:33.698564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 373/750] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:34.265045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:34.265726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:34.272487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:34.272966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:34.273399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:34.274110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:34.274556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:34.274998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:34.405105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:34.413518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:34.415003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:34.416205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e9549a6b-bb88-4e69-9169-3e2ad39a97ac tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155111 Nov 02 03:39:34.416760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 378/751] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:34 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:39:34.710352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:34.712521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:34.718856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:34.719334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:34.719765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:34.720479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:34.720934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:34.721362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:34.751193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-04af0fe0-a1dc-41d6-97d6-e02016197542 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Nov 02 03:39:34.751731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 374/752] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:35.442295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:35.442810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:35.449692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:35.450164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:35.450593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:35.451268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:35.451711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:35.452181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:35.581379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:35.590423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:35.591833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:35.592995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4adbdbbf-374e-46f0-9385-291e21b43485 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154658 Nov 02 03:39:35.593546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 379/753] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:35.763358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:35.765589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:35.771833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:35.772351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:35.772786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:35.774010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:35.774465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:35.774922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:35.803892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1fd68114-96d6-4531-9761-bb1537b406cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Nov 02 03:39:35.804472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 375/754] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:36.617237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:36.617845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:36.624200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:36.624932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:36.625365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:36.626046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:36.626492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:36.626912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:36.754706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:36.763174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:36.764737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:36.765876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f8967564-202d-471d-b7ca-bd3dcf7ced28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152547 Nov 02 03:39:36.766426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 380/755] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:39:36.816867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:36.818920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:36.826104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:36.826577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:36.827007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:36.827692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:36.828164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:36.828583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:36.860836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f392179e-96c4-4c59-a257-e78ee3bdccc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 Nov 02 03:39:36.861391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 376/756] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:37.792732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:37.793371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:37.799756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:37.800258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:37.800692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:37.801385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:37.801836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:37.802259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:37.873371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:37.875772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:37.882326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:37.883312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:37.883745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:37.884477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:37.884987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:37.885343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:37.915483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3e38f736-5edc-4aa3-a012-66a2e28672bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Nov 02 03:39:37.916085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 377/757] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:37.931564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:37.940135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:37.941566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:37.942715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-367ba37e-94d0-4e95-a1f5-297f3549def7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153972 Nov 02 03:39:37.943273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 381/758] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:38.927997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:38.930599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:38.936919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:38.937396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:38.937831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:38.938512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:38.938962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:38.939383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:38.968045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:38.968653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:38.969212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-230e2af8-d3bc-43c9-b784-4a26d8ef8a10 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Nov 02 03:39:38.969779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 378/759] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:38.975373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:38.975852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:38.976325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:38.977051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:38.977501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:38.977921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:39.103019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:39.111491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:39.112935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:39.114075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-700601d0-34f0-4fa3-a429-18f616735ae6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149955 Nov 02 03:39:39.114633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 382/760] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:39:39.981568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:39.983744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:39.989992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:39.990462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:39.990891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:39.991564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:39.992077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:39.992501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:40.021456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4c0d40a7-37e5-4f94-b056-ecdbfdb52b38 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Nov 02 03:39:40.021990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 379/761] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:40.139634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:40.140259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:40.146584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:40.147050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:40.147475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:40.148184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:40.149246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:40.149663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:40.276411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:40.286569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:40.288029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:40.289239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-94cd9da3-0974-4d7a-be61-5872fe688c10 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153434 Nov 02 03:39:40.289792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 383/762] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:41.034438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:41.036586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:41.043489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:41.043985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:41.044474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:41.045155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:41.045604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:41.046025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:41.074385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6bf577bd-3997-4911-9e51-1dc21a10cf07 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Nov 02 03:39:41.074917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 380/763] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:41.314667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:41.315277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:41.322350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:41.322829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:41.324865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:41.325601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:41.326042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:41.326617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:41.461592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:41.465049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:41.470943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:41.472404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:41.473588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-04e0b50f-428d-48ad-8ed5-fd8189c64f36 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.162750 Nov 02 03:39:41.474153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 384/764] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:42.087291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:42.089480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:42.095742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:42.096256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:42.096694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:42.097378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:42.097828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:42.098250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:42.126898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63dd9c6e-87e2-4e7f-8679-4657d6d4fa28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Nov 02 03:39:42.127374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 381/765] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:42.499166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:42.500090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:42.506474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:42.506952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:42.507384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:42.509049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:42.509788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:42.510309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:42.651874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:42.660479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:42.661909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:42.663056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-66905a5d-c505-4906-b630-00e68aebbd26 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.167989 Nov 02 03:39:42.663621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 385/766] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:43.138789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:43.140945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:43.147242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:43.147727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:43.148192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:43.148878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:43.149329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:43.149750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:43.179251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f1b53bfc-5077-4df6-98fa-f0b7a2651444 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Nov 02 03:39:43.180467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 382/767] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:43.688479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:43.689024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:43.695806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:43.696323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:43.696752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:43.697468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:43.697915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:43.698336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:43.826546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:43.834942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:43.837001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:43.838144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51a85fcb-bb76-4696-a3f8-bc83e57c2f2c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153550 Nov 02 03:39:43.838698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 386/768] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:44.192491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:44.194660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:44.201719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:44.202197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:44.202639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:44.203319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:44.203771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:44.204222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:44.232457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-981258cf-17f9-465e-83b4-cfd00e85f9aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Nov 02 03:39:44.233003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 383/769] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:44.863252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:44.863810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:44.870130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:44.870604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:44.871029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:44.871707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:44.872182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:44.872597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:44.997209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:45.005872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:45.007299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:45.008462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d9f7026d-a368-44fd-9441-d8ef49cbef5d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149122 Nov 02 03:39:45.009014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 387/770] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:45.244640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:45.246764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:45.253369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:45.253840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:45.254269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:45.254947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:45.255392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:45.255806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:45.284965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a5908211-8fdd-415e-ba0d-dcb27f2a29ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Nov 02 03:39:45.285501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 384/771] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:46.034374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:46.035011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:46.041861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:46.042348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:46.042783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:46.043468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:46.043919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:46.044433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:46.170220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:46.178730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:46.180823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:46.181967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-01c79fae-659b-4638-a1fd-a00959460c68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151554 Nov 02 03:39:46.182528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 388/772] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:46.297190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:46.299293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:46.305608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:46.306080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:46.306510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:46.307188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:46.307631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:46.308082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:46.337691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3e2a8be4-1be5-40b1-8b58-2c405d143bd1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Nov 02 03:39:46.338227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 385/773] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:47.206992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:47.207513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:47.214017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:47.214507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:47.214946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:47.215663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:47.216174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:47.216626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:47.343714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:47.349818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:47.352572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:47.352988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:47.354428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:47.355573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f620146f-e338-4c37-90b9-dfcfb2c125fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152525 Nov 02 03:39:47.356148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 389/774] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:47.358846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:47.359326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:47.359762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:47.360484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:47.360945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:47.361371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:47.390709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-13fde8c8-9467-4f8e-8fd3-f9f8bd274e63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Nov 02 03:39:47.391262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 386/775] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:48.380512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:48.381114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:48.387944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:48.388443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:48.388867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:48.389540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:48.389987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:48.390403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:48.403365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:48.405564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:48.411866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:48.412376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:48.412814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:48.413503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:48.413953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:48.414379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:48.443554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9f7d5a9e-9607-4c45-9e72-f7320e8eafc5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Nov 02 03:39:48.444247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 387/776] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:48.518319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:48.526923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:48.528394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:48.529599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-37e07449-201e-487c-854d-c4c995ab4720 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152982 Nov 02 03:39:48.530166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 390/777] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:49.456962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:49.459023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:49.466037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:49.466524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:49.466958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:49.467649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:49.468130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:49.468556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:49.500541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-47c2290e-b9ca-45b8-a94d-7856fa1723ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Nov 02 03:39:49.501372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 388/778] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:49.554286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:49.554948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:49.561348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:49.561824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:49.562257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:49.562943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:49.563392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:49.563816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:49.690368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:49.699347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:49.700806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:49.701951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eee77de7-612d-43ac-bc1e-a375a51a0ec3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151534 Nov 02 03:39:49.702510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 391/779] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:50.513527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:50.515645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:50.522019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:50.522507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:50.522945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:50.523643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:50.524132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:50.524569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:50.549999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:50.556150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da8bd329-4dc6-47f1-8aec-63568e0dc2bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Nov 02 03:39:50.556712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 389/780] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:50.727809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:50.728441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:50.734720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:50.735191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:50.735620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:50.736325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:50.736771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:50.737189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:50.868303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:50.877262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:50.878683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:50.879825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-08100d44-8a87-400a-961d-69ee8ecb9e0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156583 Nov 02 03:39:50.880417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 392/781] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:51.569024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:51.571900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:51.578196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:51.578680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:51.579119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:51.579804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:51.580288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:51.580714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:51.610129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0ba622af-2a70-4098-97e5-83e59b653589 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Nov 02 03:39:51.610683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 390/782] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:51.905094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:51.905708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:51.912079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:51.912560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:51.912993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:51.913684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:51.914132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:51.914550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:52.046384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:52.056152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:52.057712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:52.058868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d249ce5f-d842-4fa5-b0cc-245c3b3c917d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157753 Nov 02 03:39:52.059422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 393/783] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:52.622414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:52.624867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:52.631156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:52.631633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:52.632110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:52.632813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:52.633265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:52.634200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:52.664027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5dc6ddc6-cc9d-40a5-9f8b-32a7e3258391 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Nov 02 03:39:52.664583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 391/784] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:53.084071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:53.084679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:53.091516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:53.092107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:53.092534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:53.093218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:53.093662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:53.094077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:53.220184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:53.229145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:53.230560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:53.231692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-653f8047-7627-48da-871e-f411fc5626c1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151530 Nov 02 03:39:53.232281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 394/785] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:53.676583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:53.678778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:53.685770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:53.686255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:53.686686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:53.687377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:53.687825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:53.688272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:53.717126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edacf3a3-c4e0-42d7-b609-0068f148d6ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Nov 02 03:39:53.717671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 392/786] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:54.256716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:54.257329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:54.263909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:54.264418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:54.264856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:54.265540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:54.265992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:54.266418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:54.391663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:54.400735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:54.402172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:54.403332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f31416ad-85fa-4e6c-951b-3639d5a593fd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150584 Nov 02 03:39:54.403893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 395/787] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:54.729468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:54.731629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:54.738060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:54.738568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:54.739004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:54.739689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:54.740175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:54.740599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:54.770724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e9152c0-fbac-49d9-8e0c-3dc36555c7ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Nov 02 03:39:54.771287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 393/788] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:55.428369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:55.428898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:55.435267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:55.435740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:55.436214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:55.436899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:55.437349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:55.437770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:55.565993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:55.575044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:55.576496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:55.577645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ab69f4e-155d-4783-9acd-2fa119b58458 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153184 Nov 02 03:39:55.578203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 396/789] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:55.782712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:55.784973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:55.791353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:55.791831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:55.792299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:55.792987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:55.793442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:55.793903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:55.822780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0abd7f42-ab8b-4288-a686-95b632c618fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Nov 02 03:39:55.823327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 394/790] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:56.603712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:56.604378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:56.610712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:56.611183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:56.611612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:56.612316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:56.612760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:56.613178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:56.738670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:56.747116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:56.748589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:56.750013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a9e49b05-c563-4438-9905-769e0dbb1fda tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150468 Nov 02 03:39:56.750574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 397/791] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:56.834661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:56.837296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:56.843532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:56.844053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:56.844491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:56.845176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:56.845630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:56.846054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:56.875011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-11176d15-4ea4-4472-b782-c578aa5f9718 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Nov 02 03:39:56.875553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 395/792] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:57.774800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:57.775434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:57.781811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:57.782237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:57.782671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:57.783353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:57.783802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:57.784247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:57.887015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:57.889186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:57.894998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:57.895477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:57.895915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:57.896643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:57.897079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:57.897500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:57.913025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:57.921503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:57.922955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:57.924121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a39f1dc4-7432-477d-8d2e-2c844dd4c552 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153689 Nov 02 03:39:57.924878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 398/793] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:39:57.926851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-44b88f07-11a5-4664-82bf-0cf346024843 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Nov 02 03:39:57.927405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 396/794] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:39:58.938617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:58.940772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:58.943183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:58.948618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:58.949094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:58.949199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:58.949620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:58.949723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:39:58.950190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:58.950636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:58.951053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:58.955791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:58.956299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:58.956735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:58.957428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:39:58.957879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:39:58.958328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:39:58.980774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-57ef001f-b421-4d96-9160-b60feb9b6bd2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Nov 02 03:39:58.981332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 399/795] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:39:59.083045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:59.092099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:59.093532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:39:59.094674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cadd61ff-92ee-4aed-b34f-c37f276cdc49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149534 Nov 02 03:39:59.095226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 397/796] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:39:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:39:59.993047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:39:59.995161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:00.001732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:00.002201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:00.002631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:00.003305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:00.003750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:00.004214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:00.032750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-653fc969-a148-453e-ad95-c1bf30aac063 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Nov 02 03:40:00.033284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 400/797] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:39:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:00.121150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:00.121979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:00.125172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:00.130540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:00.131024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:00.131463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:00.132203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:00.132659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:00.133082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:00.258008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:00.266676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:00.268135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:00.269277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7921cca7-2ee1-494c-a2db-cf6966d47f05 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152646 Nov 02 03:40:00.269854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 398/798] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:01.044946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:01.047087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:01.053442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:01.053923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:01.054363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:01.055049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:01.055503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:01.055929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:01.072539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:01.085745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-458c13c9-a40e-4a22-9859-f5fff77ed63f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Nov 02 03:40:01.086308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 401/799] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:01.294096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:01.294698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:01.301060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:01.301481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:01.301909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:01.302614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:01.303060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:01.303478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:01.436438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:01.449113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:01.450554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:01.451750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68662c1f-7bf4-491a-b669-1441afbd8517 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.161572 Nov 02 03:40:01.452326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 399/800] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:02.104384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:02.106509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:02.112906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:02.113393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:02.113833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:02.114526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:02.114978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:02.115403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:02.146953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b76e87b3-0e53-4cb1-8ea0-11ba262eb731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047038 Nov 02 03:40:02.147430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 402/801] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:02.476602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:02.477224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:02.483564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:02.484101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:02.484544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:02.485241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:02.485697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:02.486123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:02.759268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:02.767845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:02.769318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:02.770466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-604aaaf2-7dd4-4223-aaff-8825727a8ae5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.297750 Nov 02 03:40:02.771022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 400/802] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:03.159980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:03.162103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:03.168984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:03.169466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:03.169906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:03.170594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:03.171047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:03.171471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:03.200127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-506dff04-08f0-4732-9f72-6878effe1036 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Nov 02 03:40:03.200674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 403/803] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:03.795333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:03.795855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:03.802319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:03.802798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:03.803226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:03.803901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:03.804405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:03.804820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:03.931279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:03.940257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:03.941681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:03.942841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2c56b009-6464-42d4-8159-315a8a0927ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151371 Nov 02 03:40:03.943373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 401/804] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:03 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:04.212459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:04.214692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:04.221027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:04.221509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:04.221947 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:04.222633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:04.223083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:04.223508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:04.252879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8a2e9919-c964-4290-8edc-33c5157e4fec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Nov 02 03:40:04.253431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 404/805] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:04.968888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:04.969633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:04.975798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:04.976306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:04.976735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:04.977412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:04.977857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:04.978271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:05.101233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:05.110321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:05.111742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:05.112903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-79caa542-6b94-407c-9936-20931223d8a8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.147860 Nov 02 03:40:05.113432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 402/806] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:05.266144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:05.268213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:05.274642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:05.275112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:05.276158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:05.276836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:05.277282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:05.277699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:05.306334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ca789086-9b24-4dde-8152-3595989488d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Nov 02 03:40:05.306885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 405/807] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:06.138248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:06.138772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:06.145001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:06.145477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:06.145910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:06.146594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:06.147041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:06.147461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:06.278205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:06.286619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:06.288071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:06.289218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3683dc77-1d7e-48ab-a92d-f1dbe5828919 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154962 Nov 02 03:40:06.289765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 403/808] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:06.318339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:06.320551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:06.326909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:06.327388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:06.327821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:06.328534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:06.328980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:06.329400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:06.358370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5eee3c5e-658f-4b98-b8ce-80e8b5385dbe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Nov 02 03:40:06.358898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 406/809] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:07.314330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:07.314969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:07.321435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:07.321921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:07.322963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:07.323656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:07.324222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:07.324652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:07.370815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:07.373016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:07.379536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:07.380032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:07.380463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:07.381139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:07.381587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:07.382638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:07.412022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dadc7f76-d986-4a3d-80c4-e7e172b864c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045930 Nov 02 03:40:07.412583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 407/810] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:07.450347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:07.458849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:07.460310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:07.461467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7523b245-3247-4cdb-89cc-464576a694b2 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151024 Nov 02 03:40:07.462009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 404/811] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:08.424605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:08.426629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:08.432981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:08.433476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:08.433905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:08.434577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:08.435021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:08.435432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:08.465534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dea184cf-2d0a-4bf2-96db-c1d7b3073dc9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Nov 02 03:40:08.466081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 408/812] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:08.486522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:08.487131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:08.493396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:08.493901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:08.494350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:08.495045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:08.495498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:08.495922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:08.621743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:08.630474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:08.631910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:08.633103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-06733c90-55c8-4990-be9b-75a1e437a163 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150400 Nov 02 03:40:08.633680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 405/813] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:09.477804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:09.479999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:09.486381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:09.486853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:09.487310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:09.488005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:09.488457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:09.488873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:09.518820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0350bbf8-087a-4e4b-9d0d-8a4280694488 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Nov 02 03:40:09.519356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 409/814] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:09.658529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:09.659133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:09.665584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:09.666065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:09.666500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:09.667188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:09.667639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:09.668089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:09.687180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:09.796576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:09.805147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:09.807253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:09.808437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f0844dc2-5b42-46e3-8a73-a6d9dfd42f76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153809 Nov 02 03:40:09.808982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 406/815] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:10.531757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:10.533982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:10.540361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:10.540837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:10.541272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:10.541957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:10.542407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:10.542827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:10.571113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bd81b845-e15d-4c81-8bdd-0630c8d9d829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Nov 02 03:40:10.571657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 410/816] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:10.833048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:10.833588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:10.840467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:10.840944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:10.841383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:10.842062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:10.842508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:10.842926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:10.969292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:10.978870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:10.980527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:10.981684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-403fdd34-fc60-44e5-8053-689206dd4570 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152619 Nov 02 03:40:10.982229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 407/817] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:10 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:11.584284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:11.586330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:11.592632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:11.593103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:11.593529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:11.594212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:11.594659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:11.595078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:11.624810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-45eb39cc-5948-40c4-b703-f0dd8591e6f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Nov 02 03:40:11.625359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 411/818] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:12.007296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:12.007903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:12.014870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:12.015352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:12.016095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:12.016783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:12.017229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:12.017654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:12.151786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:12.160371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:12.161810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:12.162950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-82740ebd-ea0c-493e-9621-ad2b8d17bb1e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159521 Nov 02 03:40:12.163488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 408/819] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:12.637785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:12.639897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:12.646497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:12.646967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:12.647471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:12.648189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:12.648712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:12.649132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:12.678266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-24883a05-9c53-4282-a791-01cabbd14fca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Nov 02 03:40:12.678805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 412/820] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:13.187756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:13.188396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:13.194709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:13.195190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:13.195626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:13.196342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:13.196797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:13.197223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:13.321862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:13.330499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:13.331882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:13.333061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-403851e3-2a3b-413c-8595-2719d90ff883 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149145 Nov 02 03:40:13.333603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 409/821] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:13.691159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:13.693291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:13.700127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:13.700607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:13.701045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:13.701721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:13.702171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:13.702594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:13.731548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ffd7ae8-0579-4a37-b873-ee38b3fe1313 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Nov 02 03:40:13.732108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 413/822] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:14.359327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:14.359862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:14.366326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:14.366811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:14.367250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:14.367942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:14.368424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:14.368857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:14.491797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:14.501258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:14.502723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:14.503879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dda66305-9099-4109-9b31-abbe4392c161 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.148596 Nov 02 03:40:14.504455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 410/823] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:14 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:14.743903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:14.746060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:14.752648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:14.753125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:14.753567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:14.754251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:14.754702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:14.755127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:14.784122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d14bd732-4ffe-4351-ab81-968b4451605c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Nov 02 03:40:14.784674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 414/824] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:15.528452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:15.529090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:15.535551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:15.536069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:15.536509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:15.537200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:15.537650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:15.538075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:15.667247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:15.675629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:15.677080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:15.678217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b72697d5-2988-4ff6-a101-5b1b756addc1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153687 Nov 02 03:40:15.678761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 411/825] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:15.796908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:15.798971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:15.800945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:40:15.801094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:40:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:40:15.809675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:15.810152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:15.810584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:15.811267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:15.811715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:15.812178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:15.841760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-334572ce-fb77-424a-8f6d-7feaa2f19136 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Nov 02 03:40:15.842303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 415/826] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:16.704402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:16.705284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:16.713368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:16.713850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:16.714282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:16.714968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:16.715416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:16.715838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:16.839112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:16.847521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:16.848979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:16.850171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-02638e4f-8dcc-4bf5-98f8-f2d609a67b97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149951 Nov 02 03:40:16.850692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 412/827] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:16.853482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:16.855779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:16.862161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:16.862714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:16.863221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:16.863995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:16.864523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:16.865022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:16.893792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5ec98a90-3f4b-4c9f-bb3c-411d132c938e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Nov 02 03:40:16.894337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 416/828] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:17.875157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:17.875687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:17.881956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:17.882427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:17.882859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:17.883536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:17.884005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:17.884432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:17.906525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:17.908693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:17.914956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:17.915434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:17.916467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:17.917214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:17.917668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:17.918092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:17.947526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dd97cf25-0be3-4c7a-804d-b3c717bdac81 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Nov 02 03:40:17.948284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 417/829] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:18.015612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:18.024148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:18.026129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:18.027269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-935e4171-335c-468b-bfcc-9525f8dc73bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156330 Nov 02 03:40:18.027813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 413/830] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:18.959984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:18.962145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:18.968523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:18.968998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:18.969432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:18.970114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:18.970563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:18.970981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:18.974671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:19.001673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c8b84150-215c-4420-800e-f86625dcebd8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Nov 02 03:40:19.002219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 418/831] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:19.052343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:19.052962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:19.059904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:19.060416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:19.060847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:19.061524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:19.061973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:19.062392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:19.187496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:19.195913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:19.197367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:19.198504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-44aeab7b-488b-4539-83ac-74a3ffb58694 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150092 Nov 02 03:40:19.199048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 414/832] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:20.014548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:20.016704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:20.023139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:20.023617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:20.024110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:20.024794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:20.025240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:20.025658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:20.055033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-946941a4-69ae-4d5b-a6f3-816e677b68d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Nov 02 03:40:20.055581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 419/833] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:20.224793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:20.225434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:20.231786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:20.232291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:20.232729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:20.233412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:20.233864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:20.234288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:20.360725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:20.369926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:20.371362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:20.372568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5588c595-76d8-4c80-af5f-9653d2f9927f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152693 Nov 02 03:40:20.373116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 415/834] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:21.067772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:21.069925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:21.076734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:21.077206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:21.077637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:21.078314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:21.078765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:21.079185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:21.107825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eab3bfaa-7b96-4d21-91c9-b6f4613176bc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Nov 02 03:40:21.108387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 420/835] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:21.397683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:21.398291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:21.405362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:21.405837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:21.406265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:21.406944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:21.407391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:21.407836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:21.534711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:21.543980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:21.545451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:21.546635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-60577946-2219-485d-8a26-5d1e51a57b92 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152815 Nov 02 03:40:21.547139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 416/836] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:22.121069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:22.123223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:22.129866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:22.130338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:22.130767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:22.131448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:22.131893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:22.132331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:22.160980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1aeef16a-a2c2-4eb3-966c-08b888e69bff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Nov 02 03:40:22.161519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 421/837] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:22.571024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:22.571637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:22.578430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:22.578914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:22.579356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:22.580084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:22.580543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:22.580970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:22.725521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:22.734057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:22.735494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:22.736675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-92965e38-c02a-4324-8c0c-d4c483b62a67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.169520 Nov 02 03:40:22.737220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 417/838] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:23.173422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:23.175509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:23.181781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:23.182258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:23.182686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:23.183391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:23.183836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:23.184281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:23.212273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c4ae2a58-ccdf-407f-a9f2-fe430679ccdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Nov 02 03:40:23.213315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 422/839] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:23.762452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:23.763068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:23.765765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:40:23.765900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea (ip 10.222.0.26) !!! Nov 02 03:40:23.772875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:23.773355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:23.773792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:23.774533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:23.774984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:23.775439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:23.905761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:23.914205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:23.915624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:23.916806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dcd90616-61c7-4157-9fbe-44ff3154d533 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158813 Nov 02 03:40:23.917356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 418/840] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:24.225196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:24.227301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:24.233755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:24.234229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:24.234656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:24.235336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:24.235778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:24.236218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:24.267206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-672fc526-fd6e-4a73-bcf2-518d377d3902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Nov 02 03:40:24.267757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 423/841] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:24.942065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:24.942674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:24.949466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:24.950031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:24.950466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:24.951191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:24.951639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:24.952083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:25.076697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:25.085072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:25.086495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:25.087687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-83a7c514-0c92-43b9-bde1-6f2bbe814ef0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149426 Nov 02 03:40:25.088796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 419/842] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:25.278647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:25.280939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:25.287140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:25.287607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:25.288072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:25.288745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:25.289190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:25.289628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:25.318513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a325a972-1893-4fbf-ad18-edd8c06d9bfa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Nov 02 03:40:25.319050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 424/843] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:26.113206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:26.113726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:26.120686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:26.121165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:26.121601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:26.122283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:26.122737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:26.123159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:26.330956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:26.333281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:26.339875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:26.340420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:26.340854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:26.341559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:26.342011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:26.342432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:26.374883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0fb81561-5dfa-4833-a08f-46f702bf0cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Nov 02 03:40:26.375579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 425/844] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:26.445149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:26.453587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:26.455024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:26.456197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-76bce013-1911-4258-9db1-055581e5fd67 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.346972 Nov 02 03:40:26.456758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 420/845] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:27.387606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:27.389785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:27.391731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:40:27.391876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:40:27.399230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:27.399701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:27.400166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:27.400843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:27.401285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:27.401701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:27.431718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cd60f92d-2953-468e-b2f9-0920645226eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048160 Nov 02 03:40:27.432301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 426/846] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:27.481764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:27.482373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:27.488211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:27.488692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:27.489124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:27.489810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:27.490281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:27.490700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:27.613479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:27.622477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:27.623927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:27.625363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-755c1f0a-0503-4bd1-976c-6bf0b883a00d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.147608 Nov 02 03:40:27.625924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 421/847] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:28.444084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:28.446250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:28.452890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:28.453391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:28.453853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:28.454534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:28.455009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:28.455422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:28.485236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ab0b543a-b009-4001-bc30-6f618bac7c5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Nov 02 03:40:28.485774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 427/848] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:28.651964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:28.652576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:28.659183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:28.659642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:28.660110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:28.660798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:28.661246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:28.661665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:28.789123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:28.797558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:28.798994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:28.800179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b6e91b9d-3275-4b84-bdfd-6bad5ccbb99c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152639 Nov 02 03:40:28.800723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 422/849] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:29.498411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:29.500892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:29.503145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=58 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:29.508430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:29.508910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:29.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:29.510031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:29.510480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:29.510901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:29.539624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2244b5d7-de50-4c8c-92bd-318b66005505 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Nov 02 03:40:29.540215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 428/850] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:29.825088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:29.825628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:29.831926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:29.832431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:29.832865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:29.833547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:29.833996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:29.834416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:29.838817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:29.958391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:29.967438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:29.968880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:29.970039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5e62c875-97fb-4861-91e2-03686dd55b02 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.148858 Nov 02 03:40:29.970583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 423/851] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:30.551997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:30.554183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:30.561154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:30.561636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:30.562068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:30.562755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:30.563204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:30.563624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:30.592613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c848b77-b811-44de-ac7f-12379a2c0225 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Nov 02 03:40:30.593152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 429/852] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:30.996419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:30.997030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:30.999389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:31.004878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:31.005388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:31.005826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:31.006546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:31.006997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:31.007419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:31.145970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:31.155118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:31.156783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:31.158006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3c0a9938-50e4-4e11-a555-5f8e6f6d1c39 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.166053 Nov 02 03:40:31.158546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 424/853] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:31.605078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:31.607231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:31.613678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:31.614146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:31.614576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:31.615250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:31.615694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:31.616155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:31.647018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b60bb870-a4dc-4115-8908-c8a400994a8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Nov 02 03:40:31.647561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 430/854] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:32.182811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:32.183288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:32.189647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:32.190122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:32.190555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:32.191236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:32.191680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:32.192135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:32.323987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:32.332502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:32.333963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:32.335108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8705baab-a088-4ffd-8826-e2e350eb6190 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156341 Nov 02 03:40:32.335658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 425/855] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:32.660242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:32.662373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:32.668591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:32.669056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:32.669480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:32.670148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:32.670590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:32.671005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:32.701250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3ccb0e45-4e54-42a8-8ae3-3ad802c6c9ed tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Nov 02 03:40:32.701803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 431/856] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:33.360661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:33.361275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:33.367605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:33.368131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:33.368586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:33.369868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:33.370325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:33.370753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:33.495030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:33.503898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:33.505410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:33.506565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ffb3800-85a7-4ffa-b36b-154da4007382 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149907 Nov 02 03:40:33.507118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 426/857] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:33.714389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:33.716568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:33.722850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:33.723330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:33.723764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:33.724495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:33.724947 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:33.725369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:33.755453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d9adc3d9-70be-4a1e-a861-538a079b09d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Nov 02 03:40:33.756024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 432/858] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:34.531648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:34.532285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:34.538692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:34.539170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:34.539605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:34.540334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:34.541307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:34.541729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:34.671183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:34.679759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:34.681884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:34.683043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3d076ff5-05e6-47aa-9805-bc29534a30e4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155337 Nov 02 03:40:34.683596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 427/859] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:34 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:34.768228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:34.770460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:34.777409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:34.777889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:34.778323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:34.779004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:34.779464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:34.779904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:34.808126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2bf8c42b-d23f-475c-b698-eb6390c12abd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Nov 02 03:40:34.808602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 433/860] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:35.708851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:35.709522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:35.716431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:35.716922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:35.717363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:35.718067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:35.718522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:35.718956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:35.820354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:35.822584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:35.828841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:35.829321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:35.829756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:35.830444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:35.830895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:35.831334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:35.845154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:35.854397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:35.855856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:35.857055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-993afe9e-85a9-4bb7-85c5-3840f5fbd70b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152287 Nov 02 03:40:35.857275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:35.857614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 428/861] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:35.861989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a83c022e-72e1-4871-bb4a-fe799f71ef67 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Nov 02 03:40:35.862543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 434/862] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:36.874390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:36.876840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:36.883244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:36.883754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:36.883853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:36.883977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:36.884280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:36.884982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:36.885437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:36.885862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:36.890262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:36.890935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:36.891370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:36.892088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:36.892697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:36.892955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:36.916269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-de226f6e-76c0-4bc7-af0c-43242070819b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Nov 02 03:40:36.917598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 429/863] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:37.020599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:37.029679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:37.031275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:37.032476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-75285477-43d6-41ac-8afd-c70789127076 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153856 Nov 02 03:40:37.038215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 435/864] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:36 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:37.928998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:37.931631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:37.938401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:37.938883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:37.939319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:37.940026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:37.940479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:37.940900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:37.969932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68926181-7de2-4254-8c2a-ead29f9e9b96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Nov 02 03:40:37.970474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 430/865] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:38.059300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:38.059899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:38.066211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:38.066684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:38.067110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:38.067786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:38.068262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:38.068682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:38.196567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:38.205636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:38.207110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:38.208368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-016e9baa-42a0-4986-84be-c63820e16a72 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153358 Nov 02 03:40:38.208921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 436/866] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:38.984403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:38.986569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:38.992989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:38.993462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:38.993893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:38.994571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:38.995018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:38.995435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:39.025521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6eb50366-6d0b-47ac-96f7-fccb181d39c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Nov 02 03:40:39.026080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 431/867] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:39.234032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:39.234690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:39.241021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:39.241493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:39.241923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:39.242601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:39.243048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:39.243581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:39.370473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:39.379146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:39.380600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:39.381741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c787908-a7ff-4174-aa21-e8dbe4ae778d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151608 Nov 02 03:40:39.382323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 437/868] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:39 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:40.037726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:40.039877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:40.046224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:40.046702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:40.047137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:40.047824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:40.048305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:40.048734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:40.079427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b2190b46-58dd-4d23-b960-2f96a4295c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Nov 02 03:40:40.079983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 432/869] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:40.406651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:40.407244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:40.413745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:40.414228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:40.414669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:40.415418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:40.415881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:40.416330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:40.547926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:40.557777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:40.559302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:40.560498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5420b3cc-312f-4ba6-bb53-281e79a179fe tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157820 Nov 02 03:40:40.561081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 438/870] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:41.092286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:41.094430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:41.100789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:41.101267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:41.101700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:41.102384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:41.103432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:41.103887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:41.132548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5499551e-0ac2-4e5d-91f0-c5cafa72f204 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Nov 02 03:40:41.133084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 433/871] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:41.585691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:41.586293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:41.588974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:40:41.589113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea (ip 10.222.0.26) !!! Nov 02 03:40:41.595867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:41.596441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:41.596873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:41.597556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:41.598001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:41.598421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:41.729275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:41.738277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:41.739713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:41.740875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-16cc5556-b831-4b5d-a6a6-23b6384818d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159064 Nov 02 03:40:41.741498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 439/872] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:42.144974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:42.147052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:42.153469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:42.153948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:42.154384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:42.155070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:42.155524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:42.155971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:42.185558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b68ca2a-fc60-4039-8bea-f3b1fc03a8a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Nov 02 03:40:42.186101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 434/873] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:42.766348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:42.766994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:42.773014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:42.773493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:42.773929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:42.774616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:42.775691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:42.776153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:42.908898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:42.917263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:42.918681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:42.919823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ed79434d-80d1-4a31-be9f-0f38a50761ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157319 Nov 02 03:40:42.920443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 440/874] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:43.198461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:43.200562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:43.202545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:40:43.202692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:40:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:40:43.210240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:43.210746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:43.211180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:43.211867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:43.212371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:43.212798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:43.243048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-919574e9-a677-4257-ba99-01c67f19100b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049169 Nov 02 03:40:43.244103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 435/875] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:43.944773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:43.945425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:43.951720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:43.952229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:43.952664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:43.953348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:43.953801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:43.954224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:44.082312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:44.091252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:44.092702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:44.093838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8f026ad5-10b8-4640-84ba-f1aaba421fd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152994 Nov 02 03:40:44.094392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 441/876] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:44.255656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:44.257824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:44.264463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:44.264938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:44.265694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:44.266387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:44.266838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:44.267257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:44.296133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-212fa97e-bd5f-412c-83a7-76e515e3cc64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Nov 02 03:40:44.296676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 436/877] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:45.118612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:45.119730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:45.126362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:45.126848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:45.127282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:45.127983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:45.128437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:45.128859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:45.252190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:45.260663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:45.262097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:45.263248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-526ad5b6-8e70-4d3b-94c6-7f7ff4770200 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.148683 Nov 02 03:40:45.263797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 442/878] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:45.309059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:45.311227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:45.317576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:45.318062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:45.318507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:45.319200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:45.319687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:45.320152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:45.349151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4b7c0450-4a9d-49aa-980e-836990b5474f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Nov 02 03:40:45.349713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 437/879] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:46.288137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:46.288750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:46.295076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:46.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:46.296012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:46.296699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:46.297147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:46.297571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:46.362389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:46.364717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:46.371779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:46.372300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:46.372735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:46.373433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:46.373884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:46.374306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:46.405831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f20991bd-f411-483f-99af-0475a021e674 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 Nov 02 03:40:46.406393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 438/880] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:46.432828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:46.441299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:46.442727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:46.443871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ef04bec-6ed1-450a-951c-7eb8094e82d4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159625 Nov 02 03:40:46.444457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 443/881] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:47.418082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:47.420306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:47.426622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:47.427094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:47.427526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:47.428226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:47.428676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:47.429097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:47.453883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:47.459318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-efe1de89-7fd2-46d4-aa15-8a57c08168f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Nov 02 03:40:47.459865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 439/882] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:47.470397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:47.471009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:47.477340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:47.477827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:47.478260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:47.478938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:47.479386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:47.479805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:47.606677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:47.615078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:47.616516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:47.617644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3cdf946e-b244-441a-a921-3dc7b7a4a0d5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151067 Nov 02 03:40:47.618203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 444/883] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:48.471877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:48.474060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:48.481026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:48.481510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:48.481945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:48.482632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:48.483085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:48.483510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:48.512270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c5b998d4-8e5b-4770-8e3e-eb17e967ba82 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Nov 02 03:40:48.512739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 440/884] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:48.643278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:48.643885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:48.650845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:48.651313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:48.651760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:48.652474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:48.652912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:48.653322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:48.927432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:48.935823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:48.937271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:48.938398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c19f735-dcb0-4b2b-9888-6e07fff91b58 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.298990 Nov 02 03:40:48.938933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 445/885] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:49.524859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:49.527258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:49.534014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:49.534740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:49.535397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:49.536431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:49.539230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:49.539744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:49.570861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5281696a-d6b1-491b-b499-0492633f5365 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050097 Nov 02 03:40:49.571421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 441/886] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:49.964299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:49.964906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:49.971147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:49.971616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:49.972099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:49.972774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:49.973236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:49.973635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:50.099081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:50.115217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:50.115217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:50.115217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d1202767-3abc-42ab-8e09-cbfcb80b9221 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151045 Nov 02 03:40:50.115587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 446/887] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:50.583240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:50.585444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:50.591822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:50.592337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:50.592772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:50.593461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:50.593914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:50.594336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:50.623600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4300eddb-68c2-4b5f-b107-ec1d58f708e8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Nov 02 03:40:50.624168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 442/888] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:51.136601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:51.137224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:51.143478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:51.143973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:51.144418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:51.145106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:51.145555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:51.145981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:51.278855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:51.287650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:51.289106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:51.290273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b75f60c4-a203-4917-9e70-28a0c7abb089 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158201 Nov 02 03:40:51.290809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 447/889] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:51.637046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:51.639225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:51.645595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:51.646067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:51.646506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:51.647173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:51.647618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:51.648060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:51.678113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-feb43071-1824-4079-86dc-67fb6265e974 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Nov 02 03:40:51.678684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 443/890] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:52.314940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:52.315548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:52.322453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:52.322941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:52.323381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:52.324143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:52.324606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:52.325038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:52.456568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:52.465515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:52.466928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:52.468147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-46592c27-91d2-4363-a340-4182c370308b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157008 Nov 02 03:40:52.468684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 448/891] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:52.691958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:52.694153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:52.700995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:52.701474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:52.701907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:52.702582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:52.703028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:52.703444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:52.732512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c20d96e9-c726-4c48-92b1-321ed0fef34f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Nov 02 03:40:52.733049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 444/892] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:53.494836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:53.495384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:53.502266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:53.502751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:53.503225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:53.503913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:53.504401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:53.504849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:53.630951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:53.639417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:53.640856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:53.641995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f71d7c52-f062-49c9-9b12-2a73d7e4bc8e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151733 Nov 02 03:40:53.642549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 449/893] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:53.745052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:53.747161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:53.753803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:53.754272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:53.754713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:53.755405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:53.755865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:53.756330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:53.785684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d822bc0c-a2f4-471d-bd0d-7d831a7f818e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Nov 02 03:40:53.786227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 445/894] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:54.667560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:54.668292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:54.674392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:54.674902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:54.675336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:54.676052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:54.676502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:54.676917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:54.798722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:54.801196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:54.807981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:54.808494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:54.808973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:54.809714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:54.810170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:54.810610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:54.820224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:54.829340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:54.830789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:54.831972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de8ede8b-be59-4669-926e-18850f3fffbf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.168365 Nov 02 03:40:54.832530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 450/895] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:54.841608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4187a3b2-d024-430a-9b55-9dcd40c31dde tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Nov 02 03:40:54.842164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 446/896] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:40:55.854484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:55.856682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:55.858046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:55.858666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:55.863004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:55.863594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:55.863907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:55.864615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:55.864966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:55.865077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:55.865452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:55.865552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:55.865895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:55.866590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:55.867049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:55.867484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:55.883007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:55.896111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e2803d3a-cff5-468f-9b5e-c2319bffd4c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Nov 02 03:40:55.896653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 451/897] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:55.995367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:56.004461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:56.006367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:56.007245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ee9ab9f2-954e-4b88-8f44-1596b414ac17 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153068 Nov 02 03:40:56.007804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 447/898] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:40:56.909169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:56.911225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:56.918093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:56.918566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:56.918996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:56.919669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:56.920153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:56.920570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:56.949531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b23a52e-1930-4491-a866-81dbc8ec2711 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Nov 02 03:40:56.950073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 452/899] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:57.035138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:57.036016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:57.041997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:57.042475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:57.042908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:57.043592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:57.044066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:57.044515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:57.174039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:57.182468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:57.183900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:57.185067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-90997634-415c-49f4-9a0d-af2676247413 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154532 Nov 02 03:40:57.185614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 448/900] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:57 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:57.961852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:57.964038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:57.970370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:57.970852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:57.971289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:57.971995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:57.972451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:57.972876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:58.002558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c971367f-e3cc-4816-9f7f-355e3bbefd32 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Nov 02 03:40:58.003094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 453/901] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:58.210796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:58.211403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:58.217857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:58.218279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:58.218712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:58.219387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:58.219842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:58.220274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:58.345070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:58.353473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:58.354904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:58.356060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-caed761d-e35a-4f4d-ac58-e577b0bad4f3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149141 Nov 02 03:40:58.356607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 449/902] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:40:59.015504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:59.017692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:59.024034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:59.024578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:59.025011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:59.025692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:59.026142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:59.026560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:59.055171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6b2b9e2a-a971-4f1d-b382-0260b601f43e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Nov 02 03:40:59.056270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 454/903] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:40:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:40:59.381887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:40:59.382420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:40:59.388812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:59.389292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:59.389729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:59.390413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:40:59.390866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:40:59.391290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:40:59.514600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:59.523018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:59.524509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:40:59.525667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fa0a6cc4-a2b7-420c-8736-18d3952e3857 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.147812 Nov 02 03:40:59.526852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 450/904] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:40:59 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:00.067380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:00.069594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:00.072390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=54 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:00.077968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:00.078448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:00.078884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:00.079601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:00.080116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:00.080568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:00.109970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6eb28ffc-abe6-4122-b300-5cdd6906c88b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Nov 02 03:41:00.110501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 455/905] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:00.551960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:00.552591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:00.558955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:00.559435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:00.559871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:00.560581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:00.561036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:00.561464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:00.691344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:00.701126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:00.702894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:00.704197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f34d8289-2341-4c5c-93ab-4a887584c1b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156023 Nov 02 03:41:00.704967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 451/906] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:01.123292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:01.125675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:01.131920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:01.132437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:01.132877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:01.133566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:01.134017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:01.134443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:01.163269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-143776a9-10e8-4b11-abd1-44f5ca0d159b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Nov 02 03:41:01.163809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 456/907] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:01.730437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:01.731077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:01.733431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=56 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:01.738556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:01.739044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:01.739485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:01.740214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:01.740675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:01.741103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:01.878810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:01.888424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:01.890377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:01.891221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a4a6c8fd-d558-4dbf-9475-ac13cdddc637 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.164643 Nov 02 03:41:01.891795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 452/908] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:02.176290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:02.178380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:02.185327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:02.185840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:02.186270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:02.186952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:02.187394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:02.187818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:02.216543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7b027c41-a6d9-44ca-a335-3c220b310d35 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Nov 02 03:41:02.217074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 457/909] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:02.916341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:02.917001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:02.923239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:02.923716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:02.924185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:02.924864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:02.925316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:02.925739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:03.054137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:03.063067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:03.064533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:03.065681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-054cd1e0-fc42-434c-877d-10ba8fffab80 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153285 Nov 02 03:41:03.066223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 453/910] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:03.229210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:03.231368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:03.237721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:03.238196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:03.238631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:03.239307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:03.239752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:03.240195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:03.269966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-38613c1f-5504-45db-993e-ce341138ccd4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Nov 02 03:41:03.270513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 458/911] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:04.091326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:04.092094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:04.098455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:04.098961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:04.099393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:04.100112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:04.100561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:04.100980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:04.226156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:04.235096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:04.236563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:04.237712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67ff6b5b-857c-4f06-8789-ac9a205da465 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150641 Nov 02 03:41:04.238254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 454/912] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:04.282346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:04.284543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:04.291377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:04.291857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:04.292329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:04.293019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:04.293469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:04.293893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:04.322363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a24cd661-8811-40c2-af08-b264d77293a5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Nov 02 03:41:04.322919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 459/913] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:05.263320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:05.263930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:05.275498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:05.276016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:05.277028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:05.277741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:05.278197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:05.278620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:05.334738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:05.337052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:05.344140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:05.344630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:05.345073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:05.345775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:05.346230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:05.346658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:05.376173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c9de348b-76e1-4bbf-976a-7e7322441a8a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Nov 02 03:41:05.377114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 460/914] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:05.407044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:05.415535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:05.417047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:05.418198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-438c4367-cb30-4318-bbbf-27e0608e4093 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159322 Nov 02 03:41:05.418750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 455/915] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:06.388484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:06.390631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:06.396974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:06.397459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:06.397900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:06.398589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:06.399044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:06.399504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:06.429087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0d0680da-a0da-44c6-b497-06ee3671df2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Nov 02 03:41:06.429629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 461/916] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:06.443550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:06.444261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:06.450578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:06.451054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:06.451485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:06.452200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:06.452651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:06.453069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:06.472630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:06.583358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:06.592458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:06.594332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:06.595479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ede4595-1af1-4495-8eb8-6e71e6e9c509 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155762 Nov 02 03:41:06.596077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 456/917] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:07.441499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:07.443565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:07.450439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:07.450921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:07.451360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:07.452087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:07.452544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:07.452971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:07.482771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c7c502ec-3ef8-4be9-aa12-2befe2c34f9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Nov 02 03:41:07.483337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 462/918] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:07.621209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:07.621826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:07.628455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:07.628940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:07.629378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:07.630067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:07.630520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:07.630944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:07.759149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:07.768236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:07.769653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:07.770826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ada9a61f-43e0-4c5e-9ba4-d410da777eb5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153504 Nov 02 03:41:07.771377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 457/919] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:41:08.495171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:08.497368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:08.503992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:08.504467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:08.504897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:08.505577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:08.506022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:08.506442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:08.536695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-82c0dd21-abe3-4531-bf59-7ab419dad0f1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Nov 02 03:41:08.537252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 463/920] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:08.795648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:08.796202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:08.802714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:08.803189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:08.803620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:08.804343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:08.804823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:08.805245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:08.933459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:08.941944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:08.943380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:08.944558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6e2a5d2b-be52-486a-a2a1-4957184e76ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152899 Nov 02 03:41:08.945113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 458/921] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:09.549180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:09.551309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:09.558160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:09.558775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:09.559209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:09.559887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:09.560361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:09.560778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:09.589591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51cc2ca8-3437-4106-a843-0770e49d9ffc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Nov 02 03:41:09.590133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 464/922] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:09.970137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:09.970774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:09.977118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:09.977588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:09.978015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:09.978692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:09.979142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:09.980131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:10.104334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:10.113227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:10.114658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:10.115801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c2a2955e-54e3-4e79-be30-2337ad24e1f5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149547 Nov 02 03:41:10.116372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 459/923] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:10.601906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:10.604076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:10.610408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:10.610885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:10.611322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:10.612031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:10.612487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:10.612912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:10.641912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-26fe00fc-7c39-4c47-9c72-742e044a3957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Nov 02 03:41:10.642447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 465/924] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:11.141032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:11.141635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:11.148021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:11.148447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:11.148876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:11.149557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:11.150004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:11.150433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:11.281916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:11.290635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:11.292141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:11.293286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2e91e843-a573-4064-b115-47e1ee69ae84 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156154 Nov 02 03:41:11.293818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 460/925] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:41:11.654173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:11.656369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:11.662703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:11.663183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:11.663622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:11.664332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:11.664784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:11.665212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:11.694164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c7a1e021-8d96-44c7-916b-ceee359fec65 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Nov 02 03:41:11.694725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 466/926] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:12.318119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:12.318738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:12.325190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:12.325683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:12.326124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:12.326819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:12.327276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:12.327783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:12.459154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:12.468179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:12.469614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:12.470764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f08061e9-cdf4-41ee-b9df-7ecac809c197 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156609 Nov 02 03:41:12.471318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 461/927] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:12.706849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:12.709064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:12.716074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:12.716531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:12.716966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:12.717669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:12.718118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:12.718540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:12.747499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6966f8e2-14f5-4c5f-9dda-4d48fdbd5dc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Nov 02 03:41:12.748068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 467/928] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:13.496972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:13.497610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:13.504223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:13.504699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:13.505129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:13.505810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:13.506259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:13.506677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:13.630696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:13.639089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:13.640550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:13.641694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1992cc47-3842-45fa-838b-f2fba3f259d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149220 Nov 02 03:41:13.642238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 462/929] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:13.759449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:13.761604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:13.767969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:13.768465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:13.768900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:13.769587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:13.770036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:13.770455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:13.773997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:13.799681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b52879fc-1140-422c-8f7e-99cb018a9960 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Nov 02 03:41:13.800271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 468/930] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:14.672013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:14.672624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:14.678972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:14.679445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:14.679881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:14.680589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:14.681037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:14.681460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:14.812067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:14.812753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:14.814319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:14.820609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:14.821080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:14.821511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:14.821626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:14.822195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:14.822636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:14.822943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:14.823095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:14.824130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7797ed44-9db5-4c57-9e15-0a2c9ff25069 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156013 Nov 02 03:41:14.824687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 463/931] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:14 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:14.852923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-da26adf5-cc16-4199-ba77-e578c7d77f66 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Nov 02 03:41:14.853465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 469/932] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:15.850466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:15.851022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:15.857808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:15.858280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:15.858708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:15.859389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:15.859836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:15.860280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:15.865613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:15.867748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:15.874888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:15.875375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:15.875811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:15.876538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:15.876995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:15.877449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:15.906566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0a80e69b-2c9a-4f9a-9283-9a122daf6c7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Nov 02 03:41:15.907134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 470/933] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:15.986602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:15.995129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:15.997298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:15.998641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8f45adfa-d9f2-4004-9f98-c8729634d312 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152117 Nov 02 03:41:15.999893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 464/934] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:16.918954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:16.921077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:16.927333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:16.927802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:16.928265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:16.928942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:16.929387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:16.929802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:16.959096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d63e6ba1-770b-4143-a883-0502ca454e20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Nov 02 03:41:16.959641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 471/935] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:17.024078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:17.024704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:17.032776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:17.033265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:17.033757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:17.034413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:17.034963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:17.035305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:17.162644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:17.171725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:17.173153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:17.174301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-24749621-05e8-4c23-95fb-de23e8c953f8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154217 Nov 02 03:41:17.174854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 465/936] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:17 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:17.971357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:17.973551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:17.979928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:17.980438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:17.980873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:17.981557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:17.982007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:17.982428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:18.010845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f9ff68d5-28c6-4871-9ca1-290cd442cdfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Nov 02 03:41:18.011880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 472/937] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:18.200207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:18.200817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:18.207150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:18.207626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:18.208086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:18.208769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:18.209221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:18.209640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:18.337058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:18.345760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:18.347263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:18.348469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a33538a6-87b7-4819-bee6-6fbe02ad1595 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152691 Nov 02 03:41:18.349020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 466/938] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:19.023543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:19.025726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:19.032136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:19.032614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:19.033042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:19.033723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:19.034167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:19.034583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:19.065143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-356f6c6d-ba3e-4775-b85f-bbddf1d5275c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Nov 02 03:41:19.065688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 473/939] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:19.373506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:19.374057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:19.380633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:19.381109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:19.381542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:19.382223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:19.382669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:19.383090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:19.506912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:19.516027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:19.517482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:19.518665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71b53c7c-6ff5-4e67-8d6d-1eca7f9ecc4f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149125 Nov 02 03:41:19.519226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 467/940] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:20.078099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:20.080282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:20.086526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:20.086999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:20.087429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:20.088142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:20.088590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:20.089010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:20.117591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-be5733be-7181-4f47-aba7-52bc2cbc41fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Nov 02 03:41:20.118143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 474/941] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:20.544810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:20.545425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:20.551811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:20.552325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:20.552761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:20.553450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:20.553903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:20.554327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:20.682206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:20.690803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:20.692292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:20.693458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-007df6e8-95a1-4168-a096-c8f77a82249d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153132 Nov 02 03:41:20.694013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 468/942] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:21.130702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:21.132924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:21.139320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:21.139799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:21.140272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:21.140958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:21.141404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:21.141828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:21.170629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9ae35024-a2bf-4541-8308-79d6c88e001e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Nov 02 03:41:21.171169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 475/943] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:21.719068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:21.719683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:21.726245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:21.726729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:21.727168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:21.727859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:21.728343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:21.728777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:21.864456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:21.872975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:21.874413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:21.875837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-15ea7cec-5658-41e9-86ce-ead66544deb4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.161328 Nov 02 03:41:21.876412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 469/944] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:22.182723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:22.185357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:22.191604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:22.192126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:22.192550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:22.193234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:22.193684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:22.194107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:22.222961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0681ab5e-5699-44e3-9217-386a91e8094a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Nov 02 03:41:22.223499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 476/945] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:22.902683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:22.903299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:22.909829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:22.910568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:22.910912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:22.911600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:22.912081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:22.912497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:23.045900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:23.054401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:23.055852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:23.057036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2e5937e1-a4bd-4d1f-8944-74ab7580d5f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159600 Nov 02 03:41:23.057584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 470/946] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:22 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:23.235588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:23.237799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:23.244120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:23.244601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:23.245039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:23.245815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:23.246268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:23.246695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:23.276360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c2e0adb-83e7-4542-afe1-e40852ddc5b4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Nov 02 03:41:23.277482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 477/947] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:24.082085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:24.082704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:24.089054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:24.089716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:24.090168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:24.090865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:24.091322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:24.091748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:24.222801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:24.232299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:24.233842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:24.235001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-32679028-e464-4411-b78c-08b7a409f505 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156951 Nov 02 03:41:24.235564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 471/948] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:24.289425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:24.291565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:24.298023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:24.298505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:24.298932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:24.299611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:24.300083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:24.300505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:24.329218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e5142754-0423-4693-8819-d8e805f2c231 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Nov 02 03:41:24.329756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 478/949] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:25.260937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:25.262069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:25.268523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:25.269005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:25.269442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:25.270130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:25.270583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:25.271006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:25.340897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:25.343125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:25.349622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:25.350164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:25.350661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:25.351409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:25.351925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:25.352448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:25.382110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-86728fe7-bb1e-42bb-9427-37d6ba86d95b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Nov 02 03:41:25.387357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 479/950] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:25.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:25.409515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:25.410955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:25.412174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0caac2f0-207d-4d6e-8944-fdaff58d4832 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155174 Nov 02 03:41:25.412724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 472/951] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:26.394739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:26.396943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:26.403810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:26.404326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:26.404764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:26.405444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:26.405896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:26.406321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:26.434755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-816ef4d0-9a02-4002-b5bb-bba8e8455586 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Nov 02 03:41:26.435326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 480/952] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:26.437553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:26.438163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:26.444477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:26.444950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:26.445379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:26.446054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:26.446501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:26.446918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:26.451400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:26.574418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:26.582832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:26.584282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:26.585430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8f9ff0ed-c477-480c-966c-c128ef17a5a1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151785 Nov 02 03:41:26.585974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 473/953] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:41:27.447156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:27.449876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:27.456345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:27.456823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:27.457264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:27.457951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:27.458401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:27.458823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:27.487065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce23cd02-0227-4ab0-9652-e3406c962f24 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Nov 02 03:41:27.487602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 481/954] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:27.610542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:27.611155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:27.617111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:27.617595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:27.618032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:27.618719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:27.619175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:27.619598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:27.743225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:27.752577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:27.754016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:27.755223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7e4fe1be-3a48-4a4e-a469-d94a7015aeca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.148692 Nov 02 03:41:27.755772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 474/955] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:28.499298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:28.501730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:28.508151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:28.508636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:28.509075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:28.509773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:28.510229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:28.510657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:28.543900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cd4ac59e-97df-499e-8a8c-8eed821c0e11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Nov 02 03:41:28.544488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 482/956] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:28.780835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:28.781355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:28.787624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:28.788132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:28.788570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:28.789255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:28.789704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:28.790126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:28.920257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:28.928749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:28.930203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:28.931338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-989fb4d3-6c9e-42f8-9903-3875af6a1bcd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155072 Nov 02 03:41:28.931884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 475/957] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:29.556253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:29.558395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:29.564722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:29.565201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:29.565660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:29.566341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:29.566788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:29.567207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:29.595917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d6b9295b-d04c-4ccc-93da-39fce8af572f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Nov 02 03:41:29.596481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 483/958] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:29.956882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:29.957417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:29.963758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:29.964261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:29.964712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:29.966045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:29.966496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:29.966915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:30.092171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:30.100692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:30.102125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:30.103258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-231264c8-d221-4264-bf0c-6179e863543e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150402 Nov 02 03:41:30.103804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 476/959] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:29 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:30.609054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:30.611196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:30.613494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=58 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:30.618951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:30.619426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:30.619854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:30.620566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:30.621018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:30.621468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:30.647067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:30.653301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0cc1bd26-2dc6-4b8a-a32a-bcd523002cdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048371 Nov 02 03:41:30.653842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 484/960] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:31.128818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:31.129433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:31.135908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:31.136427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:31.136915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:31.138202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:31.138661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:31.139090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:31.267181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:31.275758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:31.277261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:31.278453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ecdf901f-3a40-4f6d-8e20-d503829956c4 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153831 Nov 02 03:41:31.279005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 477/961] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:31.665514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:31.667591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:31.674576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:31.675050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:31.675481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:31.676268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:31.676721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:31.677144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:31.706218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-35141a9c-a0ac-49d6-acdd-f39b52fb9947 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Nov 02 03:41:31.706762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 485/962] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:32.304841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:32.305456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:32.307802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:32.313621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:32.314104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:32.314543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:32.315239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:32.315692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:32.316161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:32.447246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:32.457327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:32.457512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:32.458974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a9f4ea28-0ac7-40e9-8035-3a9b8895ca97 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158405 Nov 02 03:41:32.460126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 478/963] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:32.719140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:32.721510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:32.727792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:32.728331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:32.728765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:32.729457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:32.729907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:32.730330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:32.761573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-60bd741c-cee2-4a45-925a-9cd31a32a71b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Nov 02 03:41:32.762139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 486/964] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:33.484886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:33.485494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:33.491785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:33.492301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:33.492734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:33.493422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:33.493875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:33.494294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:33.624331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:33.633164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:33.634590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:33.635737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-40e5dbcd-76e1-4d66-914b-8fd5fc830b88 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155506 Nov 02 03:41:33.636320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 479/965] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:33.773509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:33.775669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:33.782689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:33.783168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:33.783600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:33.784310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:33.784796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:33.785225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:33.813751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ccd83aaf-a0dd-439e-8a07-e4900db1b8ad tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Nov 02 03:41:33.814293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 487/966] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:34.661517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:34.662125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:34.669150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:34.669643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:34.670082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:34.670781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:34.671238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:34.671667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:34.798868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:34.807357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:34.808814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:34.809958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8de3b641-313e-4bd5-b046-544e06869be8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152336 Nov 02 03:41:34.810509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 480/967] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:34 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:34.825128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:34.827305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:34.833753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:34.834227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:34.834660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:34.835338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:34.835785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:34.836244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:34.864700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-98f902c0-5af6-4b81-8fdf-03a98af50118 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Nov 02 03:41:34.865234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 488/968] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:35.835568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:35.836159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:35.846795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:35.847305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:35.847741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:35.848477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:35.848929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:35.849350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:35.877219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:35.879400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:35.885802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:35.886283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:35.886715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:35.887913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:35.888426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:35.888848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:35.919629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f4d2f23f-57e3-454b-a790-568bbfc45c7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Nov 02 03:41:35.920219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 489/969] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:35.982323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:35.990810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:35.992305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:35.993455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b7be39af-6f6b-4f2f-8fa7-dcaedc98ed9a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.161856 Nov 02 03:41:35.994004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 481/970] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:36.931858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:36.934577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:36.940963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:36.941424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:36.941858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:36.942541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:36.942993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:36.943417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:36.971818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-49547a2b-7583-48dd-ac42-a7e442f24936 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Nov 02 03:41:36.972395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 490/971] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:37.021147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:37.021753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:37.028798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:37.029619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:37.029784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:37.030470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:37.030899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:37.031358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:37.161106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:37.170200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:37.171626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:37.172806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-480897a1-3679-4a22-98f2-080f4e464a37 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155560 Nov 02 03:41:37.173354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 482/972] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:37.983396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:37.985679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:37.992090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:37.992569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:37.993004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:37.993696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:37.994146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:37.994571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:38.025531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-23116313-6c78-4057-961a-f659e9775dbc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Nov 02 03:41:38.026115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 491/973] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:38.197036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:38.197688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:38.204025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:38.204501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:38.204934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:38.205643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:38.206090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:38.206506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:38.332561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:38.341214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:38.342668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:38.343833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4d37007d-b158-43ed-968a-965722d369ff tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150724 Nov 02 03:41:38.344431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 483/974] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:39.037714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:39.039853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:39.046134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.046614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.047048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.047781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.048300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.048731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.077859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-16dbb605-055b-4ad7-a351-4e8c9b831f31 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Nov 02 03:41:39.078405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 492/975] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:39.369335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:39.369959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:39.377257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.377736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.378168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.378850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.379302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.379719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.506249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:39.515262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:39.516728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:39.517871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d0c04cb8-6afe-44d8-a0f9-17d36bc4f453 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152524 Nov 02 03:41:39.518411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 484/976] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:39 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:39.873009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:39.873502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:39.879602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.880019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.880453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.881138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:39.881586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:39.882000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:39.981419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lazy-loading 'services' on Instance uuid 3cb081e9-a274-4ed2-850c-750041b05e81 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:41:40.052396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dc2bbe3b-8440-4839-b6dd-2538309417b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81/os-volume_attachments/9e72407f-a795-40c3-a2b0-43421ffd4458" status: 202 len: 0 microversion: 2.1 time: 0.183597 Nov 02 03:41:40.053091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 493/977] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 03:41:39 2022] DELETE /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81/os-volume_attachments/9e72407f-a795-40c3-a2b0-43421ffd4458 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:41:40.089840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:40.092565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:40.098434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:40.098915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:40.099354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:40.100085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:40.101350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:40.102128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:40.134467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ee655890-b723-47e8-b35f-cee4d79cdf8f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048463 Nov 02 03:41:40.135013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 485/978] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:40.543383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:40.544117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:40.550529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:40.551013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:40.551449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:40.552174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:40.552623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:40.553042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:40.679356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:40.687790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:40.689248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:40.690389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-183bf415-1c3d-48dd-8445-52ee78d7ad77 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151459 Nov 02 03:41:40.690931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 494/979] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:41.146743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:41.149341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:41.156739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:41.157227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:41.157668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:41.158361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:41.158820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:41.159246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:41.188593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d0358197-e20c-4ba4-ad76-143dbf543aca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Nov 02 03:41:41.189146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 486/980] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:41.715759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:41.716416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:41.722962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:41.723444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:41.723885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:41.724601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:41.725078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:41.725485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:41.853247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:41.862135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:41.863565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:41.864743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c08c2b7-d678-4e23-97fb-ad60e3adfd11 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152955 Nov 02 03:41:41.865306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 495/981] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:42.200823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:42.204097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:42.210717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:42.211400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:42.212244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:42.213193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:42.213837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:42.214411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:42.247145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e7b91f2c-8418-4d75-acef-5345bc1f4039 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049639 Nov 02 03:41:42.247878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 487/982] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:42.891074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:42.891700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:42.898877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:42.899357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:42.899787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:42.900508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:42.900954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:42.901370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:43.038009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:43.046752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:43.048386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:43.049605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f03407ba-2bb3-4b1e-ba5c-d6e49b7363c6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.162881 Nov 02 03:41:43.050157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 496/983] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:42 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:43.259274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:43.261634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:43.270268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:43.270875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:43.271406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:43.272229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:43.272775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:43.273315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:43.312357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b83d6083-1e4b-4c15-96cb-21ee4429a196 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051117 Nov 02 03:41:43.312357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 488/984] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:44.076098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:44.076741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:44.082978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:44.083459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:44.083898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:44.084611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:44.085064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:44.085486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:44.213744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:44.222359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:44.223824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:44.225040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7e06ea75-d6cc-4f40-af84-befc410824e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153385 Nov 02 03:41:44.225594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 497/985] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:44.319235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:44.321183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:44.327110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:44.327590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:44.328070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:44.328767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:44.329223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:44.329649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:44.357109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:44.362447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-55335e8c-b8ab-4f78-85c5-41300e36480f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Nov 02 03:41:44.363017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 489/986] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:45.251547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:45.252184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:45.258637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:45.259114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:45.259550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:45.260265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:45.260718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:45.261142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:45.375065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:45.377261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:45.383631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:45.384162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:45.384614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:45.385320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:45.385780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:45.386208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:45.386534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:45.395837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:45.397391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:45.399014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c16768f8-a73b-40e7-baa5-afa30c129693 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151193 Nov 02 03:41:45.399650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 498/987] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:45.418606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7d84531a-5d10-4d5f-b2b6-1d315c22b5a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047207 Nov 02 03:41:45.419156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 490/988] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:46.424894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:46.425697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:46.430997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:46.432551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:46.433034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:46.433194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:46.433516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:46.434790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:46.435238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:46.435660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:46.440081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:46.440564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:46.441000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:46.441701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:46.442154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:46.442576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:46.471998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c98b022f-1942-47b0-a80a-a982bd8c5413 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Nov 02 03:41:46.472562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 491/989] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:46.568781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:46.577582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:46.579009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:46.581135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-23ae4386-4116-49e2-a408-faaf3d35df49 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159291 Nov 02 03:41:46.581898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 499/990] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:47.484929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:47.487068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:47.493453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:47.493932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:47.494369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:47.495054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:47.495507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:47.496555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:47.525690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-033f3e25-1e34-4ea1-8a58-377011153e3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Nov 02 03:41:47.526247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 492/991] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:47.606422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:47.608605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:47.614964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:47.615451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:47.615895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:47.616627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:47.617106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:47.617533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:47.746599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:47.750370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:47.756316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:47.757753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:47.758908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fff5d0b4-772a-4096-8ca9-b99e2be2b47f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157178 Nov 02 03:41:47.759455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 500/992] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:48.538686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:48.540823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:48.547779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:48.548297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:48.548734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:48.549426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:48.549881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:48.550306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:48.578767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e42cbcb4-f9f3-4cb2-bc6d-c9807c6157cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Nov 02 03:41:48.579318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 493/993] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:48.785223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:48.785831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:48.792443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:48.792868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:48.793302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:48.793979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:48.794428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:48.794846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:48.923732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:48.933112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:48.934533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:48.935673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-921f336e-dd00-4231-a5bf-1b48890a5698 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154852 Nov 02 03:41:48.936270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 501/994] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:49.591276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:49.593609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:49.599897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:49.600402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:49.600835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:49.601515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:49.601963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:49.602383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:49.632782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-02505957-0390-4ba3-858f-648f4d4913c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Nov 02 03:41:49.633316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 494/995] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:49.961284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:49.961926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:49.969080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:49.969759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:49.970353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:49.971198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:49.971645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:49.972090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:50.099430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:50.108491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:50.109908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:50.111035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a0c742a0-abff-48fd-be5e-071b67790e15 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153763 Nov 02 03:41:50.111588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 502/996] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:49 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:50.645350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:50.647487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:50.653876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:50.654350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:50.654783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:50.655465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:50.655910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:50.656358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:50.685418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b90d21c9-fe6d-4826-abef-6e7955bb7977 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Nov 02 03:41:50.685956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 495/997] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:51.136252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:51.136848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:51.143264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:51.143750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:51.144234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:51.144923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:51.145378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:51.145805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:51.273030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:51.282344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:51.283782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:51.284957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2cdad27d-526c-4792-b47f-57c55bd9230c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152693 Nov 02 03:41:51.285515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 503/998] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:51.697838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:51.700562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:51.706883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:51.707361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:51.707793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:51.708505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:51.708956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:51.709376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:51.739068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48aa717a-cfe0-4c96-85bd-5eba18ac16b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Nov 02 03:41:51.739614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 496/999] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:52.310186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:52.310788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:52.317117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:52.317587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:52.318014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:52.318688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:52.319130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:52.319548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:52.445965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:52.454342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:52.455751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:52.456942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6cc23c1e-e1a1-4f62-a330-2bb71595a0fa tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151101 Nov 02 03:41:52.457497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 504/1000] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:52.751812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:52.754045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:52.761128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:52.761617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:52.762050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:52.762740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:52.763195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:52.763619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:52.794371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-98cf6c77-d59e-4c2e-ae13-10f26b224e37 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Nov 02 03:41:52.795106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 497/1001] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:53.482687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:53.483291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:53.489715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:53.490187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:53.490618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:53.491302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:53.491747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:53.492192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:53.618568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:53.627361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:53.628824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:53.629975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-74532384-5162-4487-8d30-e645e30f8f5e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151689 Nov 02 03:41:53.630534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 505/1002] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:53 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:53.807193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:53.809344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:53.815823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:53.816343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:53.816810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:53.817499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:53.817948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:53.818368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:53.847361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bc7f4f05-3d9e-4a88-a38d-0bc70492a4d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Nov 02 03:41:53.847902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 498/1003] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:54.654676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:54.655287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:54.661354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:54.661834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:54.662272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:54.662956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:54.663412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:54.663834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:54.794083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:54.802521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:54.804000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:54.805148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1fd8d34b-5d3e-4a43-958e-9e0ae9d8bfd0 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154383 Nov 02 03:41:54.805699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 506/1004] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:54 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:54.859496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:54.861658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:54.867944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:54.868465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:54.868876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:54.869553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:54.869998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:54.870416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:54.899543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e40e2f1-2535-4b77-9e6d-5e63360c474e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Nov 02 03:41:54.900111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 499/1005] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:55.831121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:55.831660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:55.838429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:55.838910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:55.839383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:55.840049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:55.840504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:55.840924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:55.911113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:55.913620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:55.920296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:55.920773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:55.921206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:55.921893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:55.922373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:55.922796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:55.953015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9b6979b5-33a5-422d-8251-1b2ba53e4955 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Nov 02 03:41:55.953573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 500/1006] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:41:55.965899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:55.974447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:55.975875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:55.977057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-54299814-8ac6-4883-92ba-f11726551535 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149934 Nov 02 03:41:55.977609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 507/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:56.966053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:56.968254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:56.974615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:56.975096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:56.975530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:56.976244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:56.976699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:56.977125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:57.001479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:57.002093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:57.006741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ad3a3bd4-57d1-4f19-b1cf-8c160cf8298e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Nov 02 03:41:57.007478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 501/1008] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:57.008896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:57.009370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:57.009800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:57.010489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:57.010928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:57.011848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:57.146076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:57.155570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:57.157044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:57.168170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fd0e1473-ba13-406b-a938-a0346c1a3ea7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.160819 Nov 02 03:41:57.168170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 508/1009] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:56 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:41:58.019493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:58.021653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:58.028396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:58.028873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:58.029303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:58.029983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:58.030433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:58.030855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:58.060631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6733d0ad-ad43-4bb3-9ff4-d16cdb38f3f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Nov 02 03:41:58.061177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 502/1010] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:58.182659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:58.183414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:58.189964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:58.190438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:58.190862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:58.191545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:58.192013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:58.192435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:58.321882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:58.330473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:58.331899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:58.333081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6b161001-6f67-4098-ba24-432975afdb5a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154510 Nov 02 03:41:58.333636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 509/1011] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:58 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:41:59.073071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:59.075225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:59.081682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:59.082159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:59.082597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:59.083286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:59.083738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:59.084190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:59.114040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-50728be1-f05f-48ee-b4c4-7a1a2f2c9377 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Nov 02 03:41:59.114587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 503/1012] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:41:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:41:59.358829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:41:59.359420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:41:59.365864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:59.366341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:59.366771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:59.367457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:41:59.367898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:41:59.368338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:41:59.494050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:59.502833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:59.504275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:41:59.505419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-216f83c1-0b96-4c3d-af34-a15ec4135716 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150960 Nov 02 03:41:59.505972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 510/1013] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:41:59 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:00.126990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:00.129175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:00.135545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:00.136056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:00.136490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:00.137171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:00.137617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:00.138034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:00.166335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e3120979-ae4c-4ccc-a413-db9045a9e2f8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Nov 02 03:42:00.166879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 504/1014] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:00.531170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:00.531793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:00.538326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:00.538813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:00.539254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:00.539982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:00.540435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:00.540858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:00.669916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:00.678397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:00.679817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:00.680978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f6bac55b-9818-4e63-954c-476f1abb994b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154291 Nov 02 03:42:00.681529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 511/1015] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:00 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:01.179165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:01.181371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:01.188394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:01.188883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:01.189322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:01.190019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:01.190478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:01.190908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:01.220272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-15430515-b558-43b8-8c34-37ba8321ad14 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Nov 02 03:42:01.220876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 505/1016] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:01.705804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:01.706307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:01.708654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=56 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:01.713705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:01.714183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:01.715196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:01.715890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:01.716533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:01.716835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:01.843510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:01.852025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:01.853445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:01.854591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b31f42de-f535-42b6-b87f-900201ed945b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152798 Nov 02 03:42:01.855700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 512/1017] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:02.231809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:02.234001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:02.240391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:02.240875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:02.241311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:02.242000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:02.242457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:02.242884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:02.261740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:02.274847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edffe707-0113-4c31-89b1-a28185e4ab6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Nov 02 03:42:02.275409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 506/1018] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:02.880853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:02.881480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:02.888515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:02.888997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:02.889435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:02.890123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:02.890574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:02.890995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:03.018047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:03.026585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:03.028615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:03.029775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-54ac309e-a095-424f-85a0-a054c97e224e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152853 Nov 02 03:42:03.030326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 513/1019] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:02 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:03.288323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:03.290548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:03.292838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:03.298166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:03.298647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:03.299087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:03.299782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:03.300257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:03.300699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:03.330747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6ece3021-f74b-4904-a050-bd290f1b6358 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046485 Nov 02 03:42:03.331301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 507/1020] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:04.055805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:04.056445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:04.062966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:04.063443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:04.063880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:04.064610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:04.065060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:04.065480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:04.193033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:04.201552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:04.202982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:04.204198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-831562f1-6ee8-4bdc-819f-b53caaa0f211 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152223 Nov 02 03:42:04.204754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 514/1021] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:04 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:04.343852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:04.346061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:04.352801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:04.353283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:04.353720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:04.354412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:04.355485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:04.355917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:04.385068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c189ffbb-e165-4f5c-b4b5-dcf41e3dabfe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Nov 02 03:42:04.385632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:05.230349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:05.230962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:05.237310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:05.237790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:05.238225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:05.238952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:05.239403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:05.239829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:05.368793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:05.378132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:05.379558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:05.380745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ed89d849-c98d-4096-8e53-ea464732f27c tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154919 Nov 02 03:42:05.381291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 515/1023] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:05 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:05.398026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:05.400239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:05.406760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:05.407246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:05.407688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:05.408416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:05.408876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:05.409307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:05.439116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-07f175cf-1219-46db-ae84-bc55c98352d5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Nov 02 03:42:05.439663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 509/1024] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:06.405900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:06.406514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:06.413059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:06.413474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:06.413909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:06.414602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:06.415053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:06.415508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:06.452229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:06.454526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:06.461057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:06.461547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:06.462000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:06.462707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:06.463163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:06.463636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:06.494445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b032e78e-9993-4e03-93a9-226469f5e877 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Nov 02 03:42:06.495016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 510/1025] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:06.543132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:06.551578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:06.553028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:06.554177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-27cb8c44-d130-4dc1-960c-fa6abf6a2503 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152290 Nov 02 03:42:06.554725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 516/1026] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:06 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:07.506736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:07.508928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:07.515226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:07.515705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:07.516185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:07.516877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:07.517330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:07.517754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:07.547442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9c7c0a2-d798-402a-8f6d-8f162d352830 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Nov 02 03:42:07.548037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 511/1027] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:07.582493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:07.583130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:07.589891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:07.590367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:07.590832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:07.591680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:07.592174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:07.592599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:07.611617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:07.722626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:07.731995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:07.733471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:07.734684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-becdb5e3-7537-45c1-9c41-0028a21829b7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156062 Nov 02 03:42:07.735455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 517/1028] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:07 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:08.560401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:08.562577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:08.569062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:08.569535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:08.569964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:08.570637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:08.571081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:08.571499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:08.600219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f2c64245-835d-492e-b399-c78fc64ddef4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Nov 02 03:42:08.600756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 512/1029] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:08.762164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:08.762861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:08.769477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:08.769956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:08.770398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:08.771071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:08.771513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:08.771933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:08.903281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:08.912024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:08.913528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:08.914673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-44f302fd-ba13-4f12-aeee-4efb467f017b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157185 Nov 02 03:42:08.915223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 518/1030] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:08 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:09.612639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:09.614904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:09.616932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:42:09.617080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:42:09.623571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:09.624085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:09.624790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:09.625473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:09.625926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:09.626351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:09.659345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9ae8b34e-3312-4ebe-955a-08590d6423e6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050583 Nov 02 03:42:09.659906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 513/1031] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:09.939514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:09.940432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:09.946815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:09.947429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:09.948061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:09.949320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:09.949848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:09.950340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:10.074343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:10.082743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:10.084206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:10.085358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-19b93516-74a6-41f1-b40c-83367790d9a5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149765 Nov 02 03:42:10.085914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 519/1032] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:09 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:10.671526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:10.673709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:10.680131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:10.680611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:10.681051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:10.681743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:10.682196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:10.682625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:10.711937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-de769a54-69c6-4095-815a-36ee949a23fe tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Nov 02 03:42:10.712499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 514/1033] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:11.111117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:11.111757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:11.118124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:11.118595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:11.119029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:11.119720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:11.120197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:11.120623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:11.247181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:11.255918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:11.257378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:11.258531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-aa6e9aa8-6712-4402-bcf8-249d446d87f7 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151411 Nov 02 03:42:11.259089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 520/1034] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:11 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:11.723624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:11.725801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:11.732790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:11.733260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:11.733687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:11.734372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:11.734812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:11.735229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:11.764016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0335b770-5aee-4f86-86aa-c2095b62c57d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Nov 02 03:42:11.764557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 515/1035] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:12.285293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:12.285908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:12.292254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:12.292733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:12.293167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:12.293849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:12.294299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:12.294722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:12.421446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:12.429918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:12.431341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:12.432519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c4dfce76-4d03-48de-ab90-6a4efa7d72ea tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151133 Nov 02 03:42:12.433576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 521/1036] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:12 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:12.775893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:12.778094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:12.784396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:12.784873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:12.785304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:12.785987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:12.786435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:12.786854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:12.817120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d369d8b1-b7f2-4c78-bff6-c730a8458d7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Nov 02 03:42:12.817665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 516/1037] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:13.458685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:13.459209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:13.466174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:13.466651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:13.467094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:13.467780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:13.468267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:13.468689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:13.593771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:13.602286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:13.603726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:13.604978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-573dcab5-724c-4bfa-a999-65687fabf861 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150329 Nov 02 03:42:13.605528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 522/1038] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:13 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:13.830179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:13.832425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:13.839086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:13.839561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:13.840020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:13.840701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:13.841151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:13.841570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:13.869709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-78d161b1-d46f-4a55-85d4-4ef21ce244e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Nov 02 03:42:13.870734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 517/1039] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:14.630575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:14.631184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:14.637572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:14.638048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:14.638483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:14.639165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:14.639616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:14.640062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:14.767418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:14.775900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:14.778148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:14.779296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3c6b2275-66a9-49c9-8a7b-c3b2f42cd20e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.152755 Nov 02 03:42:14.779845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 523/1040] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:14 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:14.882654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:14.884830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:14.891823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:14.892329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:14.892761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:14.893448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:14.893892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:14.894310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:14.923274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-33ff717f-ff02-4f41-b7c1-9cb80a779879 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Nov 02 03:42:14.923818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 518/1041] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:15.804997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:15.805560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:15.812171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:15.812644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:15.813105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:15.813785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:15.814229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:15.814679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:15.935399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:15.937605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:15.939287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:15.944033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:15.944543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:15.944976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:15.945663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:15.946110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:15.946530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:15.948028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:15.949980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:15.951139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-41b8ac8a-f845-4ed0-ba61-3c8501821737 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150149 Nov 02 03:42:15.951698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 524/1042] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:15 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:15.976553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a6a2fe25-7f48-43c4-87ca-94987bb21386 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Nov 02 03:42:15.977096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 519/1043] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:16.976879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:16.977496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:16.984570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:16.985049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:16.985485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:16.986174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:16.986628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:16.987054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:16.988694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:16.990837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:16.997392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:16.997868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:16.998297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:16.999149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:16.999430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:17.000133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:17.032797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8009daef-d5f4-4c42-a3aa-d918cf51a74e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Nov 02 03:42:17.033697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 520/1044] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:17.119066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:17.128189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:17.129657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:17.130814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf3d81cb-2995-4578-bb2e-bf71f6b71856 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157892 Nov 02 03:42:17.131367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 525/1045] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:16 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:18.046538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:18.048729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:18.055126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:18.055608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:18.056088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:18.056784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:18.057242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:18.057673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:18.086804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-795a5dfa-c972-4a0a-ac76-e4e106dfb1b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Nov 02 03:42:18.087349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 521/1046] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:18.156064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:18.156674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:18.163066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:18.163546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:18.164003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:18.164697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:18.165149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:18.165569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:18.292149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:18.301222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:18.302672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:18.303744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9f6f6e37-83c3-4bb9-8a47-5d4cfd943615 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151554 Nov 02 03:42:18.304599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 526/1047] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:18 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:42:19.099111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:19.101333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:19.108714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:19.109193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:19.109780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:19.110313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:19.110952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:19.111466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:19.140771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bcd2a81f-4566-4880-84e8-2dbef88ae151 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Nov 02 03:42:19.141326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 522/1048] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:19.331198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:19.331812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:19.338543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:19.339026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:19.339464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:19.340188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:19.340642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:19.341065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:19.474004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:19.483248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:19.484703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:19.485853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18b247dc-239c-41ae-b0b4-b2121e524708 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158813 Nov 02 03:42:19.486400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 527/1049] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:19 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:20.154008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:20.156219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:20.162635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:20.163118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:20.163588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:20.164308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:20.164811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:20.165242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:20.168962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:20.194059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a82dc388-0257-4c8a-bdf2-ad9ac8965255 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Nov 02 03:42:20.194608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 523/1050] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:20.511371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:20.512560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:20.519552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:20.520068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:20.520507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:20.521395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:20.521854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:20.522278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:20.845062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:20.854522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:20.855942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:20.857113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c3168a4e-f4c7-4567-a694-bca44c8475b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.349555 Nov 02 03:42:20.857662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 528/1051] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:20 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:21.207028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:21.209139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:21.216697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:21.217172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:21.217602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:21.218285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:21.218732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:21.219153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:21.247987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-72923ffe-9842-4079-b125-afe2c617c91f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Nov 02 03:42:21.248524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 524/1052] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:21.884091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:21.884617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:21.891791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:21.892313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:21.892747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:21.893423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:21.893867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:21.894286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:22.019152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:22.027600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:22.029047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:22.030196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f2267f09-50c6-4e9e-95ef-a8382d1a2eef tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150133 Nov 02 03:42:22.030731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 529/1053] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:21 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:22.260497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:22.263252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:22.269703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:22.270182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:22.270621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:22.271314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:22.271771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:22.272223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:22.301870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23731611-f873-44dd-a65c-c55e3e71f63a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Nov 02 03:42:22.302424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 525/1054] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:23.054691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:23.055241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:23.062200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:23.062673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:23.063104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:23.063792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:23.064269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:23.064697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:23.191418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:23.199881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:23.201347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:23.202492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-384a9492-b718-4296-a2db-c303be37deaf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151819 Nov 02 03:42:23.203039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 530/1055] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:23 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:23.315029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:23.317169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:23.323814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:23.324330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:23.324766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:23.325457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:23.325915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:23.326348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:23.355466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-162d69a3-fe3d-40c9-b0fb-aed8727594a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Nov 02 03:42:23.356032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 526/1056] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:24.229003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:24.230184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:24.236247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:24.236733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:24.237174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:24.237870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:24.238325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:24.238754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:24.366863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:24.368124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:24.370372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:24.376184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:24.376975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:24.377462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:24.377616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:24.377906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:24.378607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:24.378773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e8f20ab0-d7d2-4ef8-8188-9724dfb1016f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153782 Nov 02 03:42:24.379065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:24.379330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 531/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:24 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:24.379492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:24.409419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8dc1ca5b-ab06-47f9-9aca-4e607b71b639 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Nov 02 03:42:24.409970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 527/1058] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:25.403557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:25.404177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:25.410535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:25.411013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:25.411441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:25.412154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:25.412611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:25.413032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:25.422196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:25.424435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:25.430816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:25.431302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:25.431742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:25.432467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:25.433545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:25.433979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:25.463103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2fe09a0c-9da8-4c0f-9f34-ee2a0ec4bc7a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Nov 02 03:42:25.463673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 528/1059] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:25.542992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:25.551517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:25.552979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:25.554129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b825ac9e-b7ac-428a-a48e-91358ee84e55 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154498 Nov 02 03:42:25.554677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 532/1060] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:25 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:26.474959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:26.477190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:26.484180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:26.484664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:26.485104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:26.485799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:26.486257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:26.486688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:26.516263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1fb4f535-af67-4515-950f-28f5dc599349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Nov 02 03:42:26.516814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 529/1061] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:26.579231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:26.579774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:26.586153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:26.586629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:26.587069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:26.587759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:26.588245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:26.588673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:26.714720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:26.723295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:26.724787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:26.725934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-813a9c35-759a-4660-a29f-28ca744952f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150673 Nov 02 03:42:26.726480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 533/1062] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:26 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:27.529265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:27.531439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:27.537561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:27.538039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:27.538474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:27.539162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:27.539613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:27.540063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:27.569170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9e3dc3e1-aa1c-4b61-b0dc-caf99ed97183 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Nov 02 03:42:27.569710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 530/1063] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:27.752096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:27.752709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:27.759243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:27.759724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:27.760197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:27.761393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:27.761846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:27.762270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:27.766311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:27.897379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:27.907934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:27.909458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:27.910657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7de865a9-d797-4724-86a6-d7a5d16d803e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.162792 Nov 02 03:42:27.911211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 534/1064] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:27 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:28.581726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:28.583834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:28.590694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:28.591167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:28.591594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:28.592296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:28.592749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:28.593171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:28.621516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-faf9c7e0-dcf7-4732-af2a-109a93d4f5ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Nov 02 03:42:28.622056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 531/1065] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:28.936842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:28.937488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:28.944511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:28.945151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:28.945587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:28.946280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:28.946730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:28.947149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:29.078749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:29.088149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:29.089658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:29.090784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b9a1e312-cfa6-4236-96a5-44fab3781a76 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158603 Nov 02 03:42:29.091332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 535/1066] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:28 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:29.634104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:29.636324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:29.642693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:29.643177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:29.643618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:29.644340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:29.644794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:29.645219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:29.674827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5713c1ea-500a-48eb-bf47-0ae15cffe24f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Nov 02 03:42:29.675398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 532/1067] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:30.115742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:30.116381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:30.122753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:30.123227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:30.123711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:30.124413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:30.125164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:30.125538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:30.250483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:30.258902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:30.260351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:30.262060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c599633f-ec19-4bc2-a693-0de09ef2268d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150184 Nov 02 03:42:30.262614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 536/1068] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:30 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:30.687188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:30.689418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:30.695686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:30.696211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:30.696651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:30.697339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:30.697791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:30.698216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:30.726599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67d37ba3-fea3-481e-94b6-8df16844a56a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Nov 02 03:42:30.727149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 533/1069] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:31.286648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:31.287253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:31.294371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:31.294840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:31.295272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:31.295976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:31.296490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:31.296907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:31.426386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:31.434733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:31.436215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:31.437360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f94ca0af-9c1c-44c9-b71d-f8c1ea75ac68 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154565 Nov 02 03:42:31.437905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 537/1070] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:31 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:31.739398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:31.741591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:31.748794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:31.749302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:31.749999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:31.750689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:31.751145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:31.751567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:31.780761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-86286aaa-bfab-4557-9e83-e50b82dadf50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Nov 02 03:42:31.781304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 534/1071] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:32.462780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:32.463396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:32.465739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:32.471066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:32.471546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:32.472010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:32.472703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:32.473158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:32.473586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:32.600024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:32.609407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:32.610843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:32.612063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-468268a2-4617-42ba-95fe-39ef62b524f1 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.153133 Nov 02 03:42:32.612620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 538/1072] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:32 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:32.792715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:32.794848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:32.801869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:32.802345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:32.802776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:32.803460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:32.803909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:32.804358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:32.832634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b27a2e77-d756-4f29-b269-5d0d3f6d979c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Nov 02 03:42:32.833104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 535/1073] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:33.638217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:33.638821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:33.645468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:33.645945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:33.646429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:33.647116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:33.647565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:33.648006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:33.778859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:33.787774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:33.789222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:33.790370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fc8934d4-6d9d-4de8-955a-06419c662f93 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156754 Nov 02 03:42:33.790923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 539/1074] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:33 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:33.844774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:33.846939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:33.849320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:33.855586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:33.856090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:33.856529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:33.857219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:33.857666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:33.858086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:33.889748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-91e2b2c6-970c-4cbb-839d-32063bb72b8e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048899 Nov 02 03:42:33.890315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 536/1075] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:34.817116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:34.817660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:34.823918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:34.824418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:34.824850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:34.825533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:34.825982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:34.826403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:34.902681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:34.904893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:34.911237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:34.911715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:34.912185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:34.912874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:34.913325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:34.913747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:34.944023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b0b4901-9630-46d2-8142-16e17e245d2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045853 Nov 02 03:42:34.944907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 537/1076] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:34.952627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:34.961035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:34.962464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:34.963618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2de0517f-c697-41c2-88eb-684d95a12a83 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150456 Nov 02 03:42:34.964739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 540/1077] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:34 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:35.956436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:35.958592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:35.965498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:35.965973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:35.966460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:35.967331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:35.967776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:35.968229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:35.990279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:35.991250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:35.998030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:35.998146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6701cf0a-485c-4e92-a4c1-0c3c2838ea52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Nov 02 03:42:35.999460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 538/1078] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:35.999859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:35.999859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:36.000588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:36.001180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:36.001691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:36.132997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:36.143394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:36.144856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:36.146012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8f98bab-ec8a-4df8-afbc-a0db92eb411a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159830 Nov 02 03:42:36.146564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 541/1079] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:35 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:42:37.010848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:37.013028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:37.019344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:37.019821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:37.020288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:37.020981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:37.021435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:37.021863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:37.048684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:37.054144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cdb4cfff-361e-4327-9765-662c2676bdd9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Nov 02 03:42:37.054703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 539/1080] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:37.172319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:37.172936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:37.179316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:37.179797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:37.180345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:37.181040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:37.181521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:37.181946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:37.315770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:37.324365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:37.325784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:37.327133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5941f910-1c53-435e-8c65-2634b9727a3f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.158732 Nov 02 03:42:37.327687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 542/1081] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:37 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:38.066786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:38.069003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:38.076173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:38.076655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:38.077088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:38.077789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:38.078241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:38.078666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:38.108523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a7215273-aae4-4bb2-ba8c-c9c1f7d5b510 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Nov 02 03:42:38.109088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 540/1082] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:38.353119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:38.353733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:38.360157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:38.360627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:38.361059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:38.361807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:38.362274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:38.362695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:38.496560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:38.506115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:38.507547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:38.508733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eeb9c19b-4ef9-40fb-ba6d-d7949a72f5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159445 Nov 02 03:42:38.509282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 543/1083] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:38 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:39.121054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:39.123207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:39.129766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:39.130244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:39.130683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:39.131369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:39.131826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:39.132301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:39.161103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f283f978-b020-45bd-8948-bad6931f35e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Nov 02 03:42:39.161643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 541/1084] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:39.534495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:39.535194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:39.541673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:39.542159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:39.542669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:39.543546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:39.544028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:39.544460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:39.675266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:39.684450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:39.685888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:39.687048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d38e20cd-3915-46f8-85e7-ad5de42aa6d6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156676 Nov 02 03:42:39.687595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 544/1085] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:39 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:40.173813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:40.175996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:40.182372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:40.183411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:40.183849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:40.184557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:40.185013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:40.185439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:40.213926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e9e721c4-ed93-4d80-8301-652cd8fad3d8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Nov 02 03:42:40.214473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 542/1086] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:40.713768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:40.714816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:40.721090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:40.721557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:40.721989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:40.722674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:40.723119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:40.723538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:40.848520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:40.856877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:40.858297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:40.859433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-15f6210d-2f4b-434f-8c80-fc7d9ed7e554 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149622 Nov 02 03:42:40.860000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 545/1087] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:40 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:41.225907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:41.228074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:41.234442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:41.234915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:41.235347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:41.236051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:41.236502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:41.236920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:41.266580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-952c8016-5162-48c7-8e87-5fdde4cb8e2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Nov 02 03:42:41.267126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 543/1088] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:41.885175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:41.885819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:41.892181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:41.892654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:41.893087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:41.893768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:41.894215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:41.894909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:42.023227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:42.032293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:42.033709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:42.034844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-db57774a-7b30-42b5-9c18-ecbdf4317f70 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.154010 Nov 02 03:42:42.035396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 546/1089] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:41 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:42.279822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:42.282177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:42.288757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:42.289230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:42.289660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:42.290338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:42.290846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:42.291270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:42.320363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fa355f70-2f31-41c2-82a8-5b8243739f47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Nov 02 03:42:42.320976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 544/1090] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:43.062291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:43.062838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:43.069332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:43.069835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:43.070273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:43.070967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:43.071422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:43.071849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:43.203034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:43.211551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:43.213029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:43.214760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6f89d102-d8da-4416-b91b-d2b9381637ca tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156528 Nov 02 03:42:43.215318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 547/1091] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:43 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:43.333226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:43.335302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:43.342197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:43.342671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:43.343137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:43.343824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:43.344305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:43.344732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:43.373308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dfa55a44-9035-443d-8ef2-ac248875b21d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Nov 02 03:42:43.373852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 545/1092] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:44.240054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:44.240682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:44.246957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:44.247425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:44.247854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:44.248557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:44.249001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:44.249417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:44.374163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:44.382893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:44.384341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:44.385207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:44.385679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0d619b44-9b9b-47bc-b530-b9028022a688 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.149333 Nov 02 03:42:44.386198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 548/1093] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:44 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:44.387375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:44.393883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:44.394361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:44.394795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:44.395493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:44.395941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:44.396391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:44.426650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-37c5e8fc-01f0-4bf7-bed9-415674396efd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Nov 02 03:42:44.427200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 546/1094] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:45.411702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:45.412355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:45.419194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:45.419668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:45.420137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:45.420825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:45.421278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:45.421699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:45.439320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:45.441535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:45.447734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:45.448287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:45.448721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:45.449405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:45.449911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:45.450334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:45.485305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cfc87f2d-699e-486a-9edf-d7ee1cdada7d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049902 Nov 02 03:42:45.485876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 547/1095] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:45.553390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:45.562424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:45.563869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:45.565044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a97a1878-1a5c-4699-97fd-ef80305382fc tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.157239 Nov 02 03:42:45.565602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 549/1096] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:45 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:46.498198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:46.500666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:46.507059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:46.507534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:46.507984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:46.508677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:46.509128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:46.509553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:46.539725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f046a313-dc43-46de-afcf-0a3ca9430c83 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Nov 02 03:42:46.540321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 548/1097] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:46.589898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:46.590469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:46.596811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:46.597282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:46.597714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:46.598391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:46.598833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:46.599254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:46.725476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:46.728827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:46.734564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:46.736007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:46.737156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e58871da-e2a5-4f64-8138-f612aa21b4bf tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.151256 Nov 02 03:42:46.737708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 550/1098] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:46 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:47.552268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:47.554430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:47.561506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:47.561985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:47.562419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:47.563103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:47.563556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:47.564003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:47.593262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-01b3f969-1f51-4707-9f3e-a1dfda9fc7d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Nov 02 03:42:47.593823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 549/1099] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:47.763579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:47.764213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:47.770561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:47.771037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:47.771478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:47.772264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:47.772718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:47.773146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:47.903242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:47.911844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:47.913294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:47.914437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae5af3f1-d9e4-4bf7-8b0b-bf005645791b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.155549 Nov 02 03:42:47.914990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 551/1100] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:47 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:48.606656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:48.608818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:48.615339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:48.615810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:48.616360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:48.617070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:48.617517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:48.618003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:48.647542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9bb00f98-b136-42cd-9359-eb8344e2abdb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Nov 02 03:42:48.648105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 550/1101] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:48.938862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:48.939466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:48.946121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:48.946794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:48.947241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:48.948003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:48.948461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:48.948935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:49.077261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:49.087879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:49.090092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:49.091272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-aca2319c-27e4-4c12-b291-d3e822925d30 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.156252 Nov 02 03:42:49.105865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 552/1102] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:48 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:49.660389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:49.662535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:49.668943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:49.669417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:49.669843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:49.670529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:49.670974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:49.671394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:49.700771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-47995e52-218b-4c2b-90e3-bb391b0e97de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Nov 02 03:42:49.701311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 551/1103] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:50.116788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:50.118302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:50.126134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:50.126619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:50.127061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:50.127772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:50.128264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:50.128696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:50.276943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:50.285651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:50.287098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:50.288281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f96eab90-546b-4539-aaf6-207dc0f09733 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.175334 Nov 02 03:42:50.288875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 553/1104] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:50 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:50.712358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:50.714510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:50.720913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:50.721387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:50.721815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:50.722494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:50.722938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:50.723364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:50.754691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67eff8b9-fd54-4034-b97a-56d256e54b78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Nov 02 03:42:50.755252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 552/1105] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:51.313579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:51.314127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:51.320716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:51.321288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:51.321644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:51.322344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:51.322796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:51.323760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:51.456959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:51.466152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:51.467578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:51.468763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-075e97a3-b307-41f0-8f7f-8b6ae0d76d01 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.159176 Nov 02 03:42:51.469359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 554/1106] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:51 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:51.767622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:51.769845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:51.776168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:51.776649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:51.777084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:51.777770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:51.778222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:51.778647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:51.806841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b5d4306f-1d85-4fc2-a640-9fdf73611298 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Nov 02 03:42:51.807960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 553/1107] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:52.493209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:52.493822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:52.500432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.500907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.501340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.502025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.502472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.502899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.628247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:52.636758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:52.638199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:52.639349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f2500363-d937-494e-80c5-e545307fbc6f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 200 len: 1746 microversion: 2.20 time: 0.150007 Nov 02 03:42:52.639906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 555/1108] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:52.720653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:52.721171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:52.727066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.727552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.728009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.728694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.729743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.730175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.818774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:52.821438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:52.827858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.828358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.828788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.829501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:52.829937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:52.830358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:52.863040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1af58e04-2a11-48ba-b5c6-a33bf5d1c599 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048209 Nov 02 03:42:52.863606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 556/1109] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:52.971828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:52.994362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-817830c1-402b-4df4-83b9-1389cf07d1b5 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments/221a3ef3-f606-4729-bcac-30398981019d" status: 202 len: 0 microversion: 2.20 time: 0.277740 Nov 02 03:42:52.995594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 554/1110] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Nov 2 03:42:52 2022] DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments/221a3ef3-f606-4729-bcac-30398981019d => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:42:53.004369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:53.006511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:53.012348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.012766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.013235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.013920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.014373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.015085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.043514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-82fa1d54-051e-4580-93d4-966f1fa3da28 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043131 Nov 02 03:42:53.044079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 557/1111] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Nov 2 03:42:52 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:42:53.107505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:53.108022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:53.114461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.114939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.115373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.116080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.116535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.116954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.141510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:42:53.147272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.compute.api [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Working on deleting snapshot 12c4bf35-e411-424a-95d5-c50551d1f020 from shelved instance... Nov 02 03:42:53.758272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Doing local delete in cell f9c6a98e-99ee-4bad-903f-8a98c80704c9(cell1) {{(pid=125411) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 03:42:53.758983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.759461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.759899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.760380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.compute.api [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 03:42:53.767095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] deallocate_for_instance() {{(pid=125411) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 03:42:53.876725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:53.878896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:53.884902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.885391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.885832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.886536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:53.886995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:53.887418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:53.917683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-068cafd4-0cd3-4d18-a440-0746b6d5ce7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Nov 02 03:42:53.918243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 558/1112] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:54.727780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Updating instance_info_cache with network_info: [] {{(pid=125411) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 03:42:54.877448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5773140-5308-4eaf-8557-2d9739c592ea", "name": "network-vif-deleted", "tag": "1d12b4d0-54ad-447a-8d59-df5c58c000f7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:42:54.887588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:54.888104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:54.888535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:54.900333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.compute.server_external_events [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] Unable to find a host for instance a5773140-5308-4eaf-8557-2d9739c592ea. Dropping event network-vif-deleted {{(pid=125410) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 03:42:54.901300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-c2719b8e-4b2b-4f68-9add-8760115e6afa req-3327f034-2cc6-42d3-bd52-50129e68bb6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.185063 Nov 02 03:42:54.901887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 559/1113] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 186 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 03:42:54.931424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:54.934290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:54.940627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:54.941110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:54.941549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:54.941871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.scheduler.client.report [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Deleted allocations for instance a5773140-5308-4eaf-8557-2d9739c592ea Nov 02 03:42:54.942249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:54.942693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:54.943116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:54.973768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4830fc19-d79e-4a49-ad7f-eef33e86aece tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046911 Nov 02 03:42:54.979168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 560/1114] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:55.074022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e199e8f7-e3ad-4df5-bb87-f70652ad126a tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 204 len: 0 microversion: 2.20 time: 1.970766 Nov 02 03:42:55.074871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 555/1115] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 03:42:53 2022] DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 0 bytes in 1972 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 03:42:55.083367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:55.083999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:55.090642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:55.091122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:55.091557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:55.092294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:55.092749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:55.093177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:55.107286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea HTTP/1.1 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:42:55.109123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 03:42:55.110918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'a5773140-5308-4eaf-8557-2d9739c592ea'} Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:42:55.115562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 03:42:55.117203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:42:55.118528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:42:55.118528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b34ff163-003d-4099-a575-62967cadf310 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 404 len: 111 microversion: 2.20 time: 0.031345 Nov 02 03:42:55.118528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 561/1116] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:55 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 03:42:55.120929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-24f791df-33e6-490e-9482-cccc1cc7a5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '.version_select at 0x7f5c922d08b0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:55.139181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-24f791df-33e6-490e-9482-cccc1cc7a5b6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400785500" status: 204 len: 0 microversion: 2.20 time: 0.023077 Nov 02 03:42:55.139851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 556/1117] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Nov 2 03:42:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400785500 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 03:42:55.890972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-89d9ffe7-972f-4e8e-b9d6-47ab77b23934 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'create', calling method: .version_select at 0x7f5c924f9a60>, body: {"keypair": {"name": "tempest-keypair-1893488488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK6f85F8IQWZ86Fw7oxEuU/QtNf6QJQCideMH2mCvOd9bjC9a8vJpSPmZeTKgmBPkUERB0whkx1M1M1H6GSfvnajB3hvIzrBJHDDz4nCnVapPMTmzLY/nqcsqW7wAu9bg=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:42:55.907387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-89d9ffe7-972f-4e8e-b9d6-47ab77b23934 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for project d56f6d222a4d4411b8f4583c61f53129. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:42:55.911539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-89d9ffe7-972f-4e8e-b9d6-47ab77b23934 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for user f16c6a2cd8594037ad47475ed1b3161c and project d56f6d222a4d4411b8f4583c61f53129. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:42:55.936393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-89d9ffe7-972f-4e8e-b9d6-47ab77b23934 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049492 Nov 02 03:42:55.936980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 562/1118] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Nov 2 03:42:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 03:42:55.987483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:55.989883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:55.996642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:55.997125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:55.997564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:55.998309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:55.998809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:55.999385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:56.032521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ff1f14a6-1421-4859-a78e-08f5e6b37f36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Nov 02 03:42:56.033007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 557/1119] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:57.047484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:57.049643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:57.056410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:57.056897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:57.057692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:57.058616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:57.059067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:57.059494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:57.090423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-436c5961-8cea-4158-a952-a60628c43c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Nov 02 03:42:57.091059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 563/1120] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:57.222060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1156697569", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "add58d78-bef4-428b-8ddb-f3f7aef42c6a"}], "security_groups": [{"name": "tempest-securitygroup--1826628773"}], "key_name": "tempest-keypair-1893488488", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:42:57.323930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] validate_networks() for [('add58d78-bef4-428b-8ddb-f3f7aef42c6a', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:42:58.004357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:42:58.004779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:42:58.005247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:42:58.005654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:42:58.006090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:42:58.015558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:58.016066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:58.016500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:58.017307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:58.017811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:58.018229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:58.035024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for project d56f6d222a4d4411b8f4583c61f53129. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:42:58.038899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Getting quotas for user f16c6a2cd8594037ad47475ed1b3161c and project d56f6d222a4d4411b8f4583c61f53129. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:42:58.049509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:42:58.051711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:42:58.099649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f04a6cc2-634b-4892-8e13-89b5dea19143 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.881990 Nov 02 03:42:58.104032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 558/1121] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Nov 2 03:42:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 03:42:58.104196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:58.105037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:58.111674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:58.111918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:58.112424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:58.112555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:58.112857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:58.113558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:58.113994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:58.114410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:58.158406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3ece3402-6e64-44de-b801-7d1575df3756 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059238 Nov 02 03:42:58.159150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 564/1122] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:42:58.172956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:58.180451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:58.181922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:58.183064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dcbd6fe8-11f5-439a-b70b-601640df009e tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1282 microversion: 2.20 time: 0.075407 Nov 02 03:42:58.183613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 559/1123] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:58 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:42:59.171654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:59.173834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:59.180501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:59.180969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:59.181401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:59.182101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:59.182544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:59.182960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:59.208537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:42:59.209071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:42:59.213898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-08c72cd2-e8d7-46e9-bf7c-88576b98f925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Nov 02 03:42:59.214453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 565/1124] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:42:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:42:59.216260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:59.216747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:59.217179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:59.217915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:42:59.218364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:42:59.218794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:42:59.279849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:59.287830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:59.289297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:42:59.290388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-08a6cbab-6624-4da8-9479-e97a03e31331 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1334 microversion: 2.20 time: 0.085787 Nov 02 03:42:59.290930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 560/1125] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:42:59 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:43:00.226197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:00.228429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:00.235012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:00.235500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:00.235938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:00.236671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:00.237121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:00.237544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:00.269703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d501313c-4612-4d0d-a0bc-5ffd24aa1f5e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Nov 02 03:43:00.274361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 566/1126] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:00.316094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:00.316843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:00.323048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:00.323527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:00.323977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:00.324724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:00.325099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:00.325519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:00.458217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:00.466340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:00.467779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:00.468907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e37d2831-783d-4b59-8134-a37abdf066e8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.157091 Nov 02 03:43:00.469474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 561/1127] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:00 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 03:43:00.946011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226afa75-e26e-405b-b366-e8afb74d7116", "tag": "c292846c-21ba-4fe5-b336-1db44e16dc9f"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:43:00.955327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:00.955803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:00.956334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:00.967661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] Creating event network-changed:c292846c-21ba-4fe5-b336-1db44e16dc9f for instance 226afa75-e26e-405b-b366-e8afb74d7116 on hv-cinder-86020 Nov 02 03:43:00.973389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-138cf536-909a-4cdb-a3fb-7f2601821d77 req-7fd69cb2-fa80-4498-8f22-a9913577083d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093389 Nov 02 03:43:00.973975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 567/1128] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:01.282255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:01.284640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:01.290852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:01.291338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:01.291773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:01.292489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:01.292966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:01.293376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:01.325384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b8896704-7260-4384-a664-19da58f49f27 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Nov 02 03:43:01.326039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 562/1129] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:01.494298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:01.495033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:01.502401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:01.502873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:01.503306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:01.504005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:01.504451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:01.504868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:01.636988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:01.644984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:01.646423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:01.647585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-19cff5df-fdb8-4890-b02f-f5a6366bca08 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.157946 Nov 02 03:43:01.648176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 568/1130] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:01 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:02.337660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:02.339758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:02.346099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:02.346570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:02.347001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:02.347689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:02.348153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:02.348568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:02.377907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-58eacfe0-8de5-49c5-999b-9a874ff9bf84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Nov 02 03:43:02.378456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 563/1131] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:02.673194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:02.673811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:02.676252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:02.681477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:02.682591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:02.683035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:02.683754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:02.684206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:02.684633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:02.814293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:02.822460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:02.824445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:02.825566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-70c6aadb-91f9-452b-8ec9-3e6840cb6101 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.156311 Nov 02 03:43:02.826120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 569/1132] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:02 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:03.390742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:03.392956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:03.399315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:03.399797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:03.400271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:03.401514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:03.401963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:03.402384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:03.430502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-57b40f8a-c4d1-4246-820c-b9c787f43b26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Nov 02 03:43:03.431034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 564/1133] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:03.851150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:03.851764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:03.858115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:03.858586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:03.859016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:03.859692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:03.860178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:03.860595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:03.878673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:03.990252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:03.998818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:04.000529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:04.001621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6f7ae529-08b7-431e-88c4-9e412d648a31 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.154373 Nov 02 03:43:04.002170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 570/1134] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:03 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:04.442791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:04.445091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:04.447623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:04.453675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:04.454153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:04.454677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:04.455420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:04.455918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:04.456423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:04.487035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d84b780c-c31c-4c40-af41-8aa828f979ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Nov 02 03:43:04.487590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 565/1135] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:05.026551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:05.027235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:05.033491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:05.033969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:05.034380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:05.035094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:05.035539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:05.035972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:05.164940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:05.173509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:05.175576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:05.176703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9b8d93b1-4762-4710-95fb-3c80eaffcf50 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.154074 Nov 02 03:43:05.177254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 571/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:05 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:05.498823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:05.501253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:05.507692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:05.508208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:05.508642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:05.509319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:05.509760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:05.510666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:05.541699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e9c22cc0-8f36-4af5-a800-decfd6bd0256 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046842 Nov 02 03:43:05.542257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 566/1137] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:05.821145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226afa75-e26e-405b-b366-e8afb74d7116", "name": "network-vif-plugged", "status": "completed", "tag": "c292846c-21ba-4fe5-b336-1db44e16dc9f"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:43:05.831534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:05.831534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:05.831871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:05.843034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] Creating event network-vif-plugged:c292846c-21ba-4fe5-b336-1db44e16dc9f for instance 226afa75-e26e-405b-b366-e8afb74d7116 on hv-cinder-86020 Nov 02 03:43:05.847932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-045d974e-98f4-4dc9-bdbb-f379d35d7971 req-9666d93c-eebf-4614-a359-78a525c47588 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084543 Nov 02 03:43:05.848524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 572/1138] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:43:06.202137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:06.202748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:06.209089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:06.209942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:06.210711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:06.211843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:06.212337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:06.212780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:06.215363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.348875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:06.357390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:06.358829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:06.359926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9cc31c7b-d24e-4e44-a3c8-68d7cd6248ae tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.162252 Nov 02 03:43:06.360500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 567/1139] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:06 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:06.551278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=4 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.555900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:06.558219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:06.564647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:06.565129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:06.565564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:06.566250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:06.566702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:06.567125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:06.598412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9705f865-f0ba-42ce-b125-80c25f0353f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Nov 02 03:43:06.598959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 573/1140] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:07.384616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:07.385242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:07.391777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:07.392280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:07.392709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:07.393388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:07.393841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:07.394258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:07.521907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:07.530885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:07.532119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:07.533228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-01a925fe-3641-461b-a656-b7ad895633b3 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1408 microversion: 2.20 time: 0.152458 Nov 02 03:43:07.533780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 568/1141] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:07 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:07.611247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:07.613449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:07.619724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:07.620234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:07.620670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:07.621355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:07.621803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:07.622229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:07.653261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-34d54975-23e5-45cd-a5d2-7fe0b3e4a531 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Nov 02 03:43:07.654075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 574/1142] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:43:08.559308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:08.559868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:08.561780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:08.562455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=8 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:08.569237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.569721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.570159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.570848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.571305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.571732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.665940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:08.668683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:08.675094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.675568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.676020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.676707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.677153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.677575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.700313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:08.708065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fe5d8867-59db-4435-9511-8a9532e26a7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Nov 02 03:43:08.708434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:08.708682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 575/1143] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:43:08.709891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:43:08.711047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8925639b-a714-479f-852a-502542e8f660 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1601 microversion: 2.20 time: 0.156320 Nov 02 03:43:08.711595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 569/1144] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:43:08 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:43:08.735250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:08.735748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:08.741438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.741921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.742354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.743042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:08.743494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:08.743926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:08.819615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-32353b87-7161-4a54-a1cd-82f49a95f2f6 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088013 Nov 02 03:43:08.820283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 576/1145] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Nov 2 03:43:08 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:43:09.720823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:09.722971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:09.730046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:09.730529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:09.730968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:09.731668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:09.732146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:09.732571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:09.753777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226afa75-e26e-405b-b366-e8afb74d7116", "tag": "c292846c-21ba-4fe5-b336-1db44e16dc9f"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:43:09.764189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21a57b25-02ab-4647-a1f0-bdd634aab9be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047263 Nov 02 03:43:09.764770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 570/1146] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:09.764929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:09.765435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:09.766588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:09.778113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] Creating event network-changed:c292846c-21ba-4fe5-b336-1db44e16dc9f for instance 226afa75-e26e-405b-b366-e8afb74d7116 on hv-cinder-86020 Nov 02 03:43:09.783643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-36ad81ed-9632-4684-8780-54ea269bac60 req-7f728088-34a9-427a-bb49-10b84a95db95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Nov 02 03:43:09.784357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 577/1147] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:10.778046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:10.780291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:10.786942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:10.787431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:10.787869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:10.788601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:10.789060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:10.789485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:10.820027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2920ebc3-1755-415f-82c2-31b64f588722 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Nov 02 03:43:10.820785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 571/1148] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:11.833021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:11.835273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:11.842601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:11.843080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:11.843513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:11.844223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:11.844672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:11.845093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:11.873225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-712de56e-9c55-47dd-8ab9-3bc3e7a81143 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Nov 02 03:43:11.873770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 578/1149] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:12.886464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:12.888669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:12.894993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:12.895471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:12.895909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:12.896717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:12.897070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:12.897854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:12.927366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e75d583-bc8c-4f88-a781-3bffa565acfc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Nov 02 03:43:12.927910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 572/1150] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:13.940365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:13.942491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:13.949317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:13.949782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:13.950208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:13.950881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:13.951324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:13.951739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:13.980601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-04286bd3-6da9-4fb9-955e-e3ea99ad7ed6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Nov 02 03:43:13.981147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 579/1151] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:14.992858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:14.995006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:15.002244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:15.002754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:15.003186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:15.003887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:15.004364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:15.004786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:15.033728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8502a814-1eb1-4980-9e81-766e4a8c8913 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Nov 02 03:43:15.034265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 573/1152] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:16.046044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:16.048306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:16.054719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:16.055195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:16.055626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:16.056341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:16.056787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:16.057207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:16.086117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c48af3a1-6ed8-4a91-ba49-2dcf9ab5f7bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Nov 02 03:43:16.086659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 580/1153] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:17.098579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:17.100705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:17.107544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:17.108085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:17.108518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:17.109193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:17.109639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:17.110056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:17.138183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-feaa912a-5544-404b-bc4e-2a00f9aed737 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Nov 02 03:43:17.138717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 574/1154] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:18.150442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:18.152540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:18.158920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:18.159390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:18.159819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:18.160528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:18.160971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:18.161388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:18.190015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cce1d743-ac31-4021-81c7-a3ecdbfa3aac tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Nov 02 03:43:18.190558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 581/1155] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:19.202587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:19.204775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:19.211256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:19.211737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:19.212214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:19.212902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:19.213354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:19.213777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:19.244365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d894e672-cece-4f82-982d-83a1138aa30b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Nov 02 03:43:19.244917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 575/1156] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:20.256770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:20.258938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:20.265505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:20.265986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:20.266425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:20.267116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:20.267569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:20.268019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:20.297590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7adaea6b-64fc-42aa-994a-099dde73a858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Nov 02 03:43:20.298139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 582/1157] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:21.310576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:21.312768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:21.319097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:21.319578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:21.320046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:21.320741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:21.321201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:21.321626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:21.352838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f11063f1-386b-46b4-8594-8b9d144a1709 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Nov 02 03:43:21.353710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 576/1158] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:22.366098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:22.368302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:22.375505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:22.376014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:22.376458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:22.377147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:22.377598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:22.378024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:22.406292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0aa5c28b-0ed2-4636-88a3-6dd2ae761c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Nov 02 03:43:22.406841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:23.418573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:23.420660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:23.427004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:23.427484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:23.427920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:23.428624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:23.429072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:23.429489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:23.458893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7afc584a-5b0a-4d0c-9b44-c57baa6d8cc6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Nov 02 03:43:23.459435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 577/1160] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:24.471370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:24.473557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:24.479408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:24.479877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:24.480334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:24.481013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:24.481452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:24.481867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:24.510961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-630c5ea5-c839-4f97-8b94-33b92da9d432 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044224 Nov 02 03:43:24.511515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 584/1161] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:25.522634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:25.524814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:25.531214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:25.531708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:25.532150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:25.532849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:25.533297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:25.533720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:25.563160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8df84d7b-1ce8-486c-bf5e-069ef55f7647 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Nov 02 03:43:25.563696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 578/1162] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:26.574562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:26.577363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:26.583594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:26.584101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:26.584531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:26.585208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:26.585651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:26.586068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:26.615116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f55c0e31-94e7-4297-bbe7-f2ceecbe6c18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Nov 02 03:43:26.615651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 585/1163] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:27.628807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:27.630869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:27.636910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:27.637384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:27.637815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:27.638495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:27.638966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:27.639388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:27.667420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0587b895-203b-4d82-be75-43443056a01e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Nov 02 03:43:27.667953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 579/1164] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:28.680343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:28.682435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:28.689318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:28.689796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:28.690231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:28.690915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:28.691365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:28.691788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:28.720758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-395cb637-f871-493a-bcad-e50cc706ea89 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Nov 02 03:43:28.721300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 586/1165] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:29.733805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:29.735909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:29.742316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:29.742818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:29.743243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:29.743917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:29.744387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:29.744807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:29.773299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-acfeb0ec-d127-475a-8195-09ef3047bc92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Nov 02 03:43:29.773830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 580/1166] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:30.785644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:30.787721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:30.794076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:30.794555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:30.795558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:30.796268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:30.796717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:30.797140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:30.826314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1dd7a288-ff53-451a-8b82-a074e0a78a47 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Nov 02 03:43:30.826881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 587/1167] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:31.839240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:31.841325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:31.847983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:31.848454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:31.848882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:31.849557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:31.850002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:31.850418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:31.880443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-479ef355-912a-451a-ae35-802409dc576a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Nov 02 03:43:31.880980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 581/1168] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:32.892927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:32.895067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:32.897476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=38 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:32.902729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:32.903214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:32.903648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:32.904399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:32.904886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:32.905316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:32.930907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:32.936868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a3588f93-809a-4c8b-8ca8-cd2e25e72a90 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Nov 02 03:43:32.937430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 588/1169] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:33.949761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:43:33.952441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:33.958880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:33.959355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:33.959790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:33.960509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:33.960959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:33.961383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:34.094249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-055731e1-99da-43c6-a237-870115d0dc56 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/action" status: 200 len: 41334 microversion: 2.1 time: 0.148270 Nov 02 03:43:34.094914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 582/1170] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:43:33 2022] POST /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa/action => generated 41334 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:43:38.810261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:38.813203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:38.820064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:38.820551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:38.820996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:38.821697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:38.822152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:38.822579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:38.853313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f20f0f40-3afe-44ba-bc37-47cb757bc723 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Nov 02 03:43:38.854080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 589/1171] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:39.866896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:39.869131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:39.871619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=36 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:39.877575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:39.878045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:39.878471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:39.879153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:39.879597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:39.880044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:39.882841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=94 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:39.911747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1cb91d67-c48e-4178-b0a9-44e49e422e3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049169 Nov 02 03:43:39.912481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 583/1172] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:40.924434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:40.926664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:40.933118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:40.933602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:40.934041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:40.934731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:40.935186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:40.935613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:40.964217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c3c0bf79-c9f6-4aaf-a113-93cd684283d7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Nov 02 03:43:40.964771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 590/1173] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:41.976967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:41.979096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:41.986299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:41.986779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:41.987217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:41.987896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:41.988384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:41.988808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:42.018316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8be7054b-e2ac-45c7-b5cd-5326732dfcf5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Nov 02 03:43:42.018851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 584/1174] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:43.031030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:43.033275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:43.039552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:43.040059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:43.040508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:43.041167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:43.041615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:43.042044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:43.071093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bb45c27c-c2d2-4109-86d9-4e2cbe2473e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Nov 02 03:43:43.071638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 591/1175] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:44.083468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:44.085574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:44.091925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:44.092445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:44.092884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:44.093574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:44.094032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:44.094461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:44.124084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2d16f4a5-6070-44ea-9f0b-7fc57b67c555 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Nov 02 03:43:44.125212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 585/1176] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:45.136663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:45.139232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:45.145589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:45.146064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:45.146495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:45.147175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:45.147622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:45.148073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:45.176819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-082f1f38-d4fc-437a-9375-9f5d58f5d41b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Nov 02 03:43:45.177353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 592/1177] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:45.735333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:45.735834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:45.741815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:45.742292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:45.742726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:45.743407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:45.743857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:45.744309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:45.767491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2fac39c1-bd2e-4183-be5c-2188b731d433 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116/ips" status: 200 len: 152 microversion: 2.20 time: 0.118236 Nov 02 03:43:45.768047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 586/1178] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Nov 2 03:43:45 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116/ips => generated 152 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:43:46.189004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:46.191181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:46.197686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:46.198155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:46.198588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:46.199299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:46.199748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:46.200193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:46.229393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c19840b1-75f5-4c8a-82d5-a2639ce8b132 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Nov 02 03:43:46.229932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 593/1179] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:47.241919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:47.244215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:47.251438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:47.251918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:47.252381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:47.253070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:47.253523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:47.253950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:47.282388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d4c09bb0-a543-4501-8e89-e84e831f5431 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Nov 02 03:43:47.282873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 587/1180] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:48.295056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:48.297284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:48.299641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:43:48.299772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:43:48.306649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:48.307155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:48.307638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:48.308354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:48.308803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:48.309216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:48.341627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-45cc4457-d438-430f-aa32-72f48cdc19e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050415 Nov 02 03:43:48.342092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 594/1181] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:49.492956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:49.495165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:49.503570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:49.504297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:49.504855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:49.506078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:49.506612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:49.507042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:49.542654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-39f8b825-1e6d-4650-b50a-8476aea2f146 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192768 Nov 02 03:43:49.543207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 588/1182] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:50.554888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:50.556876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:50.563877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:50.564391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:50.564851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:50.565541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:50.565985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:50.566410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:50.595876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4d32f07b-3791-4b08-b364-1782a5611fb5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Nov 02 03:43:50.596448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 595/1183] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:51.608082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:51.610793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:51.617876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:51.618363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:51.618803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:51.619514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:51.619987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:51.620417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:51.653921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-00f18725-3172-4ca2-bc3c-74240899abb6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050056 Nov 02 03:43:51.654501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 589/1184] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:52.665289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:52.667431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:52.674058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:52.674536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:52.674968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:52.675649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:52.676124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:52.676541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:52.706692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f3743441-a5eb-4397-b7d2-760746b5cd44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Nov 02 03:43:52.707230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 596/1185] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:53.718571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:53.721248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:53.727561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:53.728066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:53.728598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:53.729893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:53.730599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:53.731394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:53.763290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a40b6a33-b2b6-4ef0-b407-e61d78749021 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048613 Nov 02 03:43:53.763835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 590/1186] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:54.776015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:54.778203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:54.784234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:54.784708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:54.785142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:54.785825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:54.786274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:54.786696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:54.816417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0b0a9b4b-e2d1-4661-b52c-836a03fc1c49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Nov 02 03:43:54.816956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 597/1187] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:55.829341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:55.831484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:55.837946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:55.838429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:55.838870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:55.839588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:55.840066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:55.840495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:55.869028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-98d4e5c7-e940-4f81-b4da-a7f964fa5656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Nov 02 03:43:55.869582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 591/1188] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:56.881933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:56.884127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:56.890454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:56.890935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:56.891370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:56.892088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:56.892540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:56.892985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:56.921359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9d5c9bce-95dc-443c-a76f-6e1af28e6519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Nov 02 03:43:56.921907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 598/1189] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:57.934108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:57.936359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:57.943166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:57.943647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:57.944101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:57.944787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:57.945233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:57.945649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:57.975572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cc3263d7-f8d6-48b5-b880-fa76279cd5f4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Nov 02 03:43:57.976138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 592/1190] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:43:58.987920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:43:58.990116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:43:58.996352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:58.996826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:58.997255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:58.998691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:43:58.999190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:43:59.000208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:43:59.032725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e1c2fb49-2cc2-494f-8ccc-208b7c58ea0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Nov 02 03:43:59.033860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 599/1191] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:43:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:00.045691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:00.047836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:00.054314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:00.054792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:00.055229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:00.055922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:00.056402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:00.056822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:00.086826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2dfd14c3-f033-47f3-a0dd-c73218fc2c5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Nov 02 03:44:00.087375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 593/1192] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:01.099184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:01.101542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:01.108007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:01.108493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:01.108935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:01.109627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:01.110114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:01.110538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:01.140543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b1b9ca3c-b674-4520-8741-5ec5fe6b1220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Nov 02 03:44:01.141098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 600/1193] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:02.152611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:02.154746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:02.161265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:02.161754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:02.162194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:02.162886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:02.163337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:02.163761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:02.194310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1265c5d9-96ec-40a3-85d4-73733aa5391e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Nov 02 03:44:02.194866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 594/1194] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:03.206999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:03.209189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:03.211740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=26 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:03.217164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:03.217647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:03.218088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:03.218788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:03.219243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:03.219672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:03.249793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e6ae0098-fb41-4ac5-b8cc-30722f2658d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Nov 02 03:44:03.250342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 601/1195] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:04.261791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:04.264081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:04.271344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:04.271821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:04.272279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:04.272972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:04.273420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:04.273843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:04.304035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9b24a8a4-c7ec-4251-ba42-b8695e13e5f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Nov 02 03:44:04.304677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 595/1196] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:05.317373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:05.319457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:05.325841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:05.326325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:05.326761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:05.327445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:05.327895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:05.328343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:05.357851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-70cb9e6e-4af8-44ce-a68b-ec6c0553a8d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Nov 02 03:44:05.358434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 602/1197] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:06.370241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:06.372509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:06.379472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:06.379977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:06.380727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:06.381157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:06.381610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:06.382044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:06.412202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fc5710fb-c802-468d-a034-63c13ea1c04f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Nov 02 03:44:06.412770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 596/1198] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:07.425523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:07.428088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:07.434456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:07.434938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:07.435375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:07.436111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:07.436567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:07.436991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:07.467454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-06f32c74-4269-4c6d-b0d4-4fa1c1826fbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Nov 02 03:44:07.468220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 603/1199] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:08.479865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:08.482051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:08.488540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:08.489024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:08.489467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:08.490157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:08.490607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:08.491030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:08.521514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d30fc3b1-5165-4dc3-a620-10569a7f6dba tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Nov 02 03:44:08.522269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 597/1200] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:44:09.534583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:09.536796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:09.543081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:09.543557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:09.544005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:09.544686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:09.545128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:09.545548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:09.547847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=91 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:09.576831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-46b27470-49ed-459e-9163-ca4107f61a76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Nov 02 03:44:09.577393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 604/1201] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:10.589282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:10.591406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:10.593734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:10.598997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:10.599474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:10.599908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:10.600616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:10.601066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:10.601489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:10.603980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=88 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:10.632309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-386ab297-a3db-42f6-99ff-12a71da5fc3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Nov 02 03:44:10.632862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 598/1202] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:11.645025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:11.647111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:11.653575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:11.654058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:11.654493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:11.655173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:11.655623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:11.656073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:11.685846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3eb8e8fe-7631-4f15-b4bc-2475e6276d23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Nov 02 03:44:11.686488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 605/1203] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:12.698537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:12.700702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:12.707264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:12.707744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:12.708216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:12.708903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:12.709356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:12.709780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:12.738682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b1c233a3-ce2b-4c45-9919-ef0e0cffdf06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Nov 02 03:44:12.740024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 599/1204] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:13.751232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:13.753934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:13.760255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:13.760730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:13.761170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:13.761847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:13.762293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:13.762714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:13.791987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ff792e0e-461c-4c89-802e-121c51b7f0b7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Nov 02 03:44:13.792530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 606/1205] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:14.804287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:14.806414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:14.812821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:14.813301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:14.813737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:14.814424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:14.814877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:14.815301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:14.844197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71e6f145-07b2-43ed-9e7d-93fe250100c0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Nov 02 03:44:14.844737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 600/1206] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:15.856792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:15.858909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:15.866002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:15.866473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:15.866904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:15.867579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:15.868054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:15.868481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:15.897233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3970322a-9152-430a-916a-90dfae14a61e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Nov 02 03:44:15.897762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 607/1207] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:16.908884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:16.910922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:16.917223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:16.917698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:16.918129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:16.918807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:16.919253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:16.919669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:16.948538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-081fa68d-574c-40f2-8bd9-8068c43f8179 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Nov 02 03:44:16.949078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 601/1208] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:17.961170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:17.963334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:17.969744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:17.970226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:17.970660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:17.971350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:17.972385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:17.972812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:18.002264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c21fbde-c3cb-4279-83fa-1e75f45a71b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Nov 02 03:44:18.002818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 608/1209] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:19.014547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:19.016738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:19.023685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:19.024159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:19.024606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:19.025301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:19.025758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:19.026189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:19.054832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-55f6ce7c-e7a7-4637-8c17-05e7f3de3623 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Nov 02 03:44:19.055368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 602/1210] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:20.067145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:20.069397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:20.075734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:20.076250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:20.076692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:20.077382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:20.077884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:20.078265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:20.106569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6f3f8a5b-5441-4798-a14a-6d720128fd6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Nov 02 03:44:20.107115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 609/1211] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:21.119275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:21.121356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:21.128498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:21.128975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:21.129414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:21.130098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:21.130550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:21.130970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:21.159889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-38e7b92a-a68f-4c43-94d9-cc48b15b39d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Nov 02 03:44:21.160461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 603/1212] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:22.172430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:22.175281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:22.181647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:22.182127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:22.182565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:22.183260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:22.183709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:22.184168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:22.212859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3b61d11a-5813-48fb-9575-9e7c3ce5209d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Nov 02 03:44:22.213401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 610/1213] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:23.225140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:23.227275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:23.233727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:23.234208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:23.234661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:23.235326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:23.235779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:23.236228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:23.265776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b32a0b3a-3f4c-4c1b-8c61-e9cd4d503a66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Nov 02 03:44:23.266315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 604/1214] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:24.278186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:24.280413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:24.286838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:24.287320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:24.287791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:24.288513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:24.288969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:24.289390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:24.318621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-83fe5295-b454-48cc-aa5f-65fcac70eca8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Nov 02 03:44:24.319100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 611/1215] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:25.331337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:25.333625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:25.340055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:25.340537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:25.340975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:25.341659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:25.342113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:25.342539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:25.371615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b2c05805-cb79-44a6-88c4-b5141d5a1281 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Nov 02 03:44:25.372154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 605/1216] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:26.384557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:26.386682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:26.393651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:26.394132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:26.394570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:26.395256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:26.395702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:26.396241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:26.424530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7e806f6d-b930-4805-b85d-fa7fd6aa7e7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Nov 02 03:44:26.425077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 612/1217] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:27.436897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:27.439075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:27.444968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:27.445449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:27.445880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:27.446558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:27.447005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:27.447425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:27.476601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48999d32-e8b2-4aaa-b214-e26948c17696 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Nov 02 03:44:27.477130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 606/1218] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:28.489277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:28.491423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:28.497822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:28.498298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:28.498734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:28.499683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:28.500161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:28.500588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:28.530150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a03d9e00-b163-4b39-8cc7-d46fe63f9c2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Nov 02 03:44:28.530444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 613/1219] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:29.542719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:29.544902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:29.551896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:29.552422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:29.552859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:29.553546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:29.553995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:29.554420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:29.583879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-441724d9-8e93-4f52-9e48-f43173030f31 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Nov 02 03:44:29.584464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 607/1220] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:30.596268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:30.598421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:30.604830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:30.605308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:30.605743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:30.606430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:30.606884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:30.607309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:30.637440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-68e11f7d-3287-42ff-be71-4d677aeee0f0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Nov 02 03:44:30.637924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 614/1221] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:31.650342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:31.652537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:31.659129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:31.659624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:31.660273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:31.660999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:31.661455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:31.661910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:31.690268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3fe6f86d-eced-4546-b295-7d035a72c148 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Nov 02 03:44:31.691320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 608/1222] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:32.703114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:32.705269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:32.712171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:32.712648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:32.713083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:32.713766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:32.714215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:32.714637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:32.743968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e0919449-96da-4670-8563-1dc42300ba4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Nov 02 03:44:32.744518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 615/1223] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:44:33.757086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:33.759251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:33.765700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:33.766178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:33.766619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:33.767303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:33.767756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:33.768206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:33.796948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-964c1f94-eaf6-40d7-9767-8392a82d20d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Nov 02 03:44:33.797434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 609/1224] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:34.809808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:34.812275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:34.814626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:34.820406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:34.820884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:34.821322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:34.822003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:34.822445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:34.823136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:34.852503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-83b95f77-7797-461b-a07d-17ed39a2054c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Nov 02 03:44:34.853059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 616/1225] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:35.865294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:35.867381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:35.874030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:35.874783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:35.875220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:35.875915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:35.876398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:35.876824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:35.906228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b9192a3-f58e-4bfd-adde-e4d1178dd2f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Nov 02 03:44:35.906794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 610/1226] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:36.919264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:36.921443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:36.928453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:36.928933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:36.929368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:36.930332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:36.930785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:36.931211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:36.960136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d84e4ed6-85ab-4d80-b9ce-281ab7fbab11 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Nov 02 03:44:36.960675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 617/1227] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:37.972387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:37.974558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:37.980849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:37.981321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:37.981751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:37.982428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:37.982875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:37.983290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:38.013023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dbb07874-0e78-4822-abb0-30c3e34ab047 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Nov 02 03:44:38.013566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 611/1228] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:39.026366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:39.028601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:39.035387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:39.035879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:39.036350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:39.037062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:39.037520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:39.037949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:39.070003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8760e58b-74ac-43c9-9f21-ed5e47521b47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047483 Nov 02 03:44:39.070498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 618/1229] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:40.082241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:40.084385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:40.090732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:40.091208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:40.091657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:40.092416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:40.092865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:40.093286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:40.122435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ca292bb0-97be-4d49-a84e-1dc27bd11574 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Nov 02 03:44:40.122965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 612/1230] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:41.135226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:41.137432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:41.143693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:41.144209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:41.144646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:41.145328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:41.145780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:41.146202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:41.149743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:41.175632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-83810703-6b27-433b-be8e-32bec2a5b248 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Nov 02 03:44:41.176217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 619/1231] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:42.187846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:42.189954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:42.192730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:42.197786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:42.198244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:42.198671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:42.199345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:42.199794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:42.200228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:42.202671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:42.230558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3e8b18af-a683-46c2-9513-7cce7297d9f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Nov 02 03:44:42.231104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 613/1232] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:43.242684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:43.244882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:43.251512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:43.252015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:43.252456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:43.253138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:43.253587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:43.254018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:43.283489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e132244-a39e-4416-85e7-1b0dc051f5e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Nov 02 03:44:43.284056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 620/1233] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:44.296241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:44.298423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:44.305522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:44.306009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:44.306452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:44.307149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:44.307614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:44.308071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:44.337513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7a29bc0b-884d-4d21-9e2e-3388ec919a37 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Nov 02 03:44:44.338062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 614/1234] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:45.350380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:45.352572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:45.358850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:45.359320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:45.359750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:45.360451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:45.360897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:45.361315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:45.390343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-62830c7d-c9e2-413a-915a-80c642455720 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Nov 02 03:44:45.390884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 621/1235] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:46.402564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:46.404809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:46.411282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:46.411757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:46.412218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:46.412896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:46.413345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:46.413765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:46.443168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-04b1e1f1-959b-44a3-87af-69224924b42a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Nov 02 03:44:46.443699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 615/1236] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:47.454650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:47.456872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:47.463594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:47.464112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:47.464556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:47.465249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:47.465711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:47.466140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:47.495661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-17541892-8817-4756-8291-f9278a583f77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Nov 02 03:44:47.496245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 622/1237] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:48.509239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:48.511364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:48.517752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:48.518226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:48.518654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:48.519330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:48.519774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:48.520243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:48.548973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fe21a9ee-fb2f-4423-b937-1929dee89627 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Nov 02 03:44:48.549519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 616/1238] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:49.561701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:49.563871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:49.570288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:49.570764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:49.571202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:49.571891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:49.572365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:49.572790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:49.602804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4294f9ec-bd38-45d5-80d4-da2a7c0b13e3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Nov 02 03:44:49.603347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 623/1239] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:50.614741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:50.616988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:50.623827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:50.624604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:50.625047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:50.625744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:50.626229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:50.626657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:50.656810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-30d2bfa7-8335-4ef1-bfc8-cce8b9753215 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Nov 02 03:44:50.657579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 617/1240] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:51.669110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:51.671304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:51.677987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:51.678468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:51.678904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:51.679593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:51.680068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:51.680494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:51.709437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d907b28f-8ade-4ea3-8bab-0e7f4ecd2deb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Nov 02 03:44:51.709983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 624/1241] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:52.722110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:52.724272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:52.730560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:52.731044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:52.731481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:52.732200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:52.732655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:52.733081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:52.762904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8aa53a3e-3d78-429c-9c05-f2bd664513de tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Nov 02 03:44:52.763447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 618/1242] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:53.774529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:53.776698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:53.783234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:53.783658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:53.784162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:53.784849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:53.785301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:53.785722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:53.814848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b66047ce-1f30-4969-85ed-0ca3e1368c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Nov 02 03:44:53.816037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 625/1243] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:54.827604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:54.829826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:54.836814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:54.837288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:54.837718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:54.838398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:54.838846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:54.839263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:54.868034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-13f65553-ae57-43fc-8ec0-d80310e83df5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Nov 02 03:44:54.868577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 619/1244] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:55.882020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:55.884274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:55.890431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:55.890915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:55.891354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:55.892082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:55.892537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:55.892963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:55.922631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-953cd48e-b05b-4120-8532-69c268cc2c77 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Nov 02 03:44:55.923176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 626/1245] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:56.934715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:56.937027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:56.943847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:56.944378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:56.944829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:56.945508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:56.945961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:56.946387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:56.974720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6c66aa11-0e17-4dc8-9bd6-ac740eea944c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Nov 02 03:44:56.975427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 620/1246] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:57.986663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:57.988953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:57.995280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:57.995762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:57.996230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:57.996922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:57.997371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:57.997795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:58.027335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ebd5fe40-8430-4115-b594-806b5f5e0f7f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Nov 02 03:44:58.027882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 627/1247] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:44:59.038519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:44:59.040729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:44:59.046917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:59.047465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:59.047902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:59.048613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:44:59.049064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:44:59.049983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:44:59.078645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-021d18d1-944b-4d17-ae2a-0b991a75ecfe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Nov 02 03:44:59.079186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 621/1248] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:44:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:00.090516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:00.092812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:00.099509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:00.100016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:00.100459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:00.101151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:00.101608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:00.102035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:00.131756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dbe89895-0467-40f5-9f4b-cb286d2e9c62 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Nov 02 03:45:00.132336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 628/1249] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:01.144686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:01.146911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:01.153099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:01.153632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:01.153994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:01.154683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:01.155130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:01.155548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:01.184956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-396531f6-b063-4075-b3e4-ce15dd432365 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Nov 02 03:45:01.185497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 622/1250] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:02.197061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:02.199256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:02.206103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:02.206595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:02.207029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:02.207721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:02.208216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:02.208643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:02.238283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-52a16600-c673-4f8d-9d8c-84d23d20593f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Nov 02 03:45:02.238835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 629/1251] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:45:03.250962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:03.253313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:03.259500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:03.260064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:03.260505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:03.261196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:03.261648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:03.262096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:03.292661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-31178cdf-6a9a-4ea8-8a69-65b3255c2fbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Nov 02 03:45:03.293219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 623/1252] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:04.306274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:04.310121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:04.316215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:04.316693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:04.317124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:04.317816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:04.318259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:04.318679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:04.348120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a71354f3-d636-44fa-9ffa-5f1f6d8146dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Nov 02 03:45:04.348677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 630/1253] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:05.359754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:05.361945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:05.370041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:05.370535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:05.370978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:05.371681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:05.372165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:05.372667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:05.403579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f39700d9-e805-4f01-935a-4f5e5a1ca34d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047787 Nov 02 03:45:05.404152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 624/1254] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:06.416226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:06.418599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:06.420835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:06.426346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:06.426827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:06.427259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:06.427962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:06.428413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:06.428834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:06.459027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-387e827a-2213-4ddf-aa53-891587d3a502 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046723 Nov 02 03:45:06.459851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 631/1255] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:07.472101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:07.474239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:07.480947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:07.481425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:07.481860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:07.482541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:07.482992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:07.483424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:07.517531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1c3e6865-82e7-49b7-8365-2c5eaab272d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050756 Nov 02 03:45:07.518246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 625/1256] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:08.530318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:08.533069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:08.545131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:08.545131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:08.545131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:08.545131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:08.545422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:08.545422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:08.572981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a80425af-7839-4802-ab02-3b5a62709af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046666 Nov 02 03:45:08.573741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 632/1257] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:09.585740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:09.587880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:09.593961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:09.594517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:09.594865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:09.595551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:09.596024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:09.597024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:09.626722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7012413a-5b36-4337-bb14-a1ea6328157e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Nov 02 03:45:09.627377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 626/1258] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:10.638649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:10.640849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:10.647112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:10.647588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:10.648055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:10.648741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:10.649188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:10.649609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:10.680678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d7de56ed-c8ce-44ad-a30d-e2c3215f59b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Nov 02 03:45:10.681228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 633/1259] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:11.693472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:11.695797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:11.702116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:11.702600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:11.703038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:11.703729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:11.704261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:11.704685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:11.733648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e4b48fec-224e-4c2d-97dd-d1befe8ce237 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Nov 02 03:45:11.734205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 627/1260] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:12.746422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:12.748638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:12.755748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:12.756257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:12.756696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:12.757394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:12.757851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:12.758277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:12.762077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:12.788910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b731b855-b3da-43ac-8237-50ac30182ba6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Nov 02 03:45:12.789662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 634/1261] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:13.801968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:13.804250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:13.806522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:13.811793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:13.812307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:13.812743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:13.813433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:13.813885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:13.814310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:13.816900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:13.852304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2f771cc-192f-4bf8-ad21-337f3ac26ddd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Nov 02 03:45:13.852304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 628/1262] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:14.857523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:14.859603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:14.866663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:14.867138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:14.867576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:14.868307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:14.868763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:14.869185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:14.908635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c873cd8-c0be-4281-87a3-5594f383a9b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046724 Nov 02 03:45:14.908635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 635/1263] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:15.912845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:15.914981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:15.921443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:15.921929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:15.922366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:15.923063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:15.923517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:15.923943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:15.954994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c9af9981-90f9-485f-a9ca-6b97ff1170b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Nov 02 03:45:15.966204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 629/1264] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:16.967214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:16.969437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:16.975861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:16.976371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:16.976809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:16.977530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:16.977969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:16.978345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:17.008774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0937e783-ed5f-4dc8-b185-3cbdb9f4349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Nov 02 03:45:17.009335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 636/1265] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:18.022380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:18.024579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:18.030990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:18.031646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:18.031895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:18.032611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:18.033066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:18.033494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:18.062593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a2e2c7ce-4da9-470d-ba10-780aac88d30a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Nov 02 03:45:18.063156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 630/1266] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:19.074979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:19.077191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:19.079541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:45:19.079689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:45:19.087652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:19.088168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:19.089104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:19.089311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:19.089727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:19.090147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:19.124291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-04c73531-3c3e-4aad-8f75-4978bd9f8c42 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053459 Nov 02 03:45:19.125375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 637/1267] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:20.137043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:20.139269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:20.146097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:20.146571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:20.147004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:20.147686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:20.148170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:20.148616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:20.178646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-06f43b54-5d9d-4bf8-8343-3ee1284b6256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Nov 02 03:45:20.179200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 631/1268] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:21.191049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:21.193240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:21.199591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:21.200109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:21.200554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:21.201241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:21.201688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:21.202108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:21.230896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3270b6fe-c61b-4376-8ad8-7849249a999e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Nov 02 03:45:21.231373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 638/1269] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:22.243321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:22.245534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:22.252330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:22.252826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:22.253902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:22.254599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:22.255061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:22.255489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:22.283968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23ae8669-805f-4335-862a-db6097d1c221 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Nov 02 03:45:22.284512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 632/1270] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:23.296288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:23.298447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:23.304968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:23.305480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:23.305914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:23.306601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:23.307052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:23.307475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:23.336981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-deb346cf-84bc-4bdf-89aa-29658da04ac2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Nov 02 03:45:23.337529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 639/1271] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:24.349824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:24.351979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:24.358311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:24.358796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:24.359265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:24.359971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:24.360436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:24.360864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:24.390322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9f2f1e4b-6374-426a-a6eb-0a43df76ddf1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044938 Nov 02 03:45:24.390870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 633/1272] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:25.402835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:25.405031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:25.411124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:25.411606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:25.412070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:25.412757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:25.413203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:25.413625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:25.443194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-352c078d-c74a-446e-8411-529cc64ffe65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Nov 02 03:45:25.443740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 640/1273] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:26.455631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:26.458380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:26.460784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:45:26.460929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:45:26.466818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:26.467298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:26.467732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:26.468448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:26.468897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:26.469321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:26.498650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8151dcf8-f3eb-4367-b2a1-029392fd55d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Nov 02 03:45:26.499187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 634/1274] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:27.511637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:27.513824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:27.520413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:27.520925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:27.521362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:27.522052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:27.522499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:27.522926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:27.552694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-aa788220-4b32-4651-b863-c454660037d4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Nov 02 03:45:27.553245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 641/1275] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:28.565339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:28.568019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:28.573965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:28.574443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:28.574878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:28.575564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:28.576051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:28.576478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:28.605306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1231a9be-7712-45bb-a6cc-7b920cf0bcf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Nov 02 03:45:28.605859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 635/1276] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:29.618130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:29.620349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:29.627152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:29.627621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:29.628124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:29.628815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:29.629263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:29.629682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:29.658855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a232bb2c-d132-4914-81a9-dcae26e980f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Nov 02 03:45:29.660016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 642/1277] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:30.672155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:30.674267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:30.681083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:30.681587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:30.682019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:30.682705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:30.683155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:30.683570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:30.713492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4cfff42d-af60-4a5f-9276-b23107fbddec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Nov 02 03:45:30.714039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 636/1278] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:31.726147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:31.728379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:31.734722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:31.735203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:31.735656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:31.736374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:31.736824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:31.737247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:31.767412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3650776e-274e-46fd-8f52-3404a855d6b3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Nov 02 03:45:31.767969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 643/1279] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:32.780541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:32.782611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:32.784649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:45:32.784791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:45:32.791825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:32.792345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:32.792796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:32.793494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:32.793954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:32.794384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:32.826979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-45dd279a-4b6b-4186-a5ad-1e0c2c938295 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050448 Nov 02 03:45:32.827521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 637/1280] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:33.839426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:33.841604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:33.847993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:33.848472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:33.848906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:33.849588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:33.850038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:33.850461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:33.879603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3ea728e2-d842-418d-ba69-eefd149e8590 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Nov 02 03:45:33.880178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 644/1281] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:34.891977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:34.894707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:34.901072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:34.901554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:34.901995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:34.902682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:34.903137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:34.903564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:34.932382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5d1175b6-c170-4ce6-87c2-9a58173dad6b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Nov 02 03:45:34.932919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 638/1282] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:35.945318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:35.947609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:35.954117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:35.954596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:35.955031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:35.955716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:35.956191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:35.956618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:35.986343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c5d0e898-4f2a-469c-8ad2-a00f9ef081d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Nov 02 03:45:35.986911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 645/1283] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:37.001470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:37.003630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:37.010864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:37.011340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:37.011773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:37.012495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:37.012945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:37.013365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:37.049465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-89ff0f94-f52c-471c-9939-38d002fe98e7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054100 Nov 02 03:45:37.050389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 639/1284] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:38.062520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:38.064797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:38.067137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:38.072261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:38.072738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:38.073171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:38.073855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:38.074305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:38.074730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:38.104493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9671b769-4c7d-48b6-824d-6247486d9d91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Nov 02 03:45:38.105038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 646/1285] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:39.116747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:39.118905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:39.126032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:39.126515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:39.126954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:39.127678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:39.128164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:39.128596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:39.158927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-72cb482e-e06d-48c7-a2b8-7f3f86d65d1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Nov 02 03:45:39.159472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 640/1286] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:40.171918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:40.174097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:40.180930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:40.181403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:40.181833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:40.182516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:40.182967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:40.183390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:40.212853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7312f0f2-d9ff-46f2-b0e0-5c49b182557f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Nov 02 03:45:40.213405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 647/1287] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:41.225332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:41.227520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:41.233923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:41.234410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:41.234862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:41.235551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:41.236029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:41.236462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:41.265780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0feddd90-1d9e-40d7-aa53-3fd70a0f4cd9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Nov 02 03:45:41.266323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 641/1288] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:42.278609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:42.280771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:42.287296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:42.288409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:42.288840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:42.289552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:42.289996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:42.290417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:42.318648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e33a340-bcc0-4ce2-b663-c852526c7f2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Nov 02 03:45:42.319190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 648/1289] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:43.330740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:43.332880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:43.339160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:43.339631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:43.340092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:43.340766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:43.341210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:43.341628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:43.371927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-004cab38-3953-451f-a065-12454f2b8807 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Nov 02 03:45:43.372497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 642/1290] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:44.385218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:44.387358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:44.389321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:45:44.389461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:45:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:45:44.397573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:44.398049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:44.398484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:44.399174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:44.399625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:44.400084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:44.404197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:44.430133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c0096ae4-79fe-4565-8116-c4230ff8f256 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049389 Nov 02 03:45:44.430676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 649/1291] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:45.442534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:45.444587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:45.446511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:45:45.446657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:45:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:45:45.448699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:45.455352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:45.455840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:45.456327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:45.457026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:45.457482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:45.457911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:45.462323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:45:45.490347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-503cfedf-9053-4d09-9359-5828562561ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051819 Nov 02 03:45:45.490893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 643/1292] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:46.502982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:46.505213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:46.511665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:46.512189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:46.512632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:46.513323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:46.513779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:46.514207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:46.543632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-68ce9e40-a7ea-42ab-bc34-ed942553010b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Nov 02 03:45:46.544220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 650/1293] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:47.556675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:47.558844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:47.565301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:47.565773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:47.566203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:47.566878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:47.567325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:47.567744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:47.596366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-382c2362-5c9d-416b-8d73-f65ae1ad84d8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Nov 02 03:45:47.596900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 644/1294] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:48.608841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:48.610991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:48.617922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:48.618400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:48.618833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:48.619518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:48.619986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:48.620413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:48.649555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0efa4c42-2268-4d3e-bb4e-0407145ab717 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Nov 02 03:45:48.650093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 651/1295] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:49.662067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:49.664303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:49.670681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:49.671153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:49.671588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:49.672296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:49.672743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:49.673165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:49.701853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63062471-593e-49ae-b5af-cedebe1051e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Nov 02 03:45:49.702390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 645/1296] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:50.714702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:50.716891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:50.723299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:50.723779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:50.724248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:50.725596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:50.726042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:50.726466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:50.757076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e7d643e-4eab-43f0-9c37-d2014ae6f961 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046300 Nov 02 03:45:50.757632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 652/1297] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:51.769587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:51.771768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:51.778187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:51.778667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:51.779107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:51.779794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:51.780273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:51.780699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:51.810203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ea8996ed-66ce-47b4-99ec-ceb7186f2d0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Nov 02 03:45:51.810743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 646/1298] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:52.823155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:52.825378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:52.831737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:52.832263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:52.832698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:52.833388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:52.833836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:52.834257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:52.864880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-302ec4eb-fd91-4e0d-90c8-58110375681b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Nov 02 03:45:52.865950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 653/1299] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:53.878017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:53.880111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:53.886918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:53.887397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:53.887831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:53.888548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:53.889002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:53.889426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:53.918900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7cd5bb78-401d-43e3-b570-8c4b04cdd5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Nov 02 03:45:53.919459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 647/1300] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:54.931592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:54.933804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:54.939647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:54.940169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:54.940608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:54.941295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:54.941747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:54.942171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:54.971818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-38227850-56c9-45a3-9d30-930124b2a1e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Nov 02 03:45:54.972407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 654/1301] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:55.984633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:55.986796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:55.993975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:55.994448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:55.994879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:55.995563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:55.996053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:55.996474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:56.025684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4e2243bd-19c5-4242-ba70-ecf23c16e299 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Nov 02 03:45:56.026221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 648/1302] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:57.037874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:57.040095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:57.046966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:57.047448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:57.047887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:57.048612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:57.049063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:57.049495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:57.078481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2788eb7e-c76b-444e-a24e-97925b15bf19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Nov 02 03:45:57.079037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 655/1303] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:58.091351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:58.093578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:58.100119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:58.100611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:58.101047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:58.101722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:58.102168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:58.102586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:58.131176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-55b3bfd3-3cd6-423d-ae39-749826dad614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Nov 02 03:45:58.131725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 649/1304] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:45:59.143641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:45:59.145744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:45:59.152223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:59.152701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:59.153136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:59.153822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:45:59.154273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:45:59.154695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:45:59.184224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d2f39811-9d2d-420d-9399-f564425d6864 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Nov 02 03:45:59.184774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 656/1305] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:45:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:00.196834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:00.198878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:00.205290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:00.205765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:00.206199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:00.206882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:00.207329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:00.207857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:00.236288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fc3cf3e1-f8cd-423d-bb42-bc61beea675b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Nov 02 03:46:00.236819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 650/1306] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:01.249364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:01.251810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:01.258713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:01.259194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:01.259624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:01.260337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:01.260787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:01.261203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:01.289894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6ffe3ff5-9693-4140-8e2c-d9a78009c9eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Nov 02 03:46:01.290441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 657/1307] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:02.302811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:02.305092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:02.311638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:02.312156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:02.312603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:02.313297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:02.313753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:02.314181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:02.343817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-429e562f-025f-4d29-85ee-9f5417f0987b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Nov 02 03:46:02.344511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 651/1308] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:03.356800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:03.358942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:03.365291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:03.365766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:03.366207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:03.366895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:03.367344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:03.367768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:03.396837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2d4e53b3-d2ec-4022-bf87-3e1acd0df6f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Nov 02 03:46:03.397380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 658/1309] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:04.409110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:04.411153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:04.418188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:04.418667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:04.419095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:04.419773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:04.420255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:04.420684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:04.449414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7fb497d6-f747-4dc0-b88d-1a0163871ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Nov 02 03:46:04.449952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 652/1310] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:05.462457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:05.464659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:05.471085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:05.471564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:05.472024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:05.472716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:05.473172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:05.473599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:05.502630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5ee896d2-7e55-4a3d-9b37-9c3880fe9110 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Nov 02 03:46:05.503172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 659/1311] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:06.515584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:06.517745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:06.524993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:06.525516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:06.525958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:06.526657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:06.527117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:06.527544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:06.557443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1d1ba107-1a1d-4317-b0d0-797df7ff7c19 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Nov 02 03:46:06.557992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 653/1312] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:07.570909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:07.573086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:07.579420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:07.579915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:07.580372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:07.581136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:07.581587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:07.582012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:07.610759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2ef9ce17-f2f5-4faf-807e-71ec34506b6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Nov 02 03:46:07.611294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 660/1313] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:08.623138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:08.625610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:08.632033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:08.632515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:08.632952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:08.633639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:08.634092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:08.634513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:08.664482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fff95b1d-7b0d-4b43-af4d-5a711e090a71 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Nov 02 03:46:08.665025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 654/1314] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:09.676973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:09.679089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:09.681497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:09.686707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:09.687214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:09.687639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:09.688357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:09.688814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:09.689246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:09.719446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-71e2330a-67ef-4a97-b178-a4a2102a8c0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Nov 02 03:46:09.720013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 661/1315] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:10.732283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:10.734467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:10.740947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:10.742020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:10.742467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:10.743171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:10.743623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:10.744079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:10.772762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b19a0925-77de-4468-87d2-7e026e9345d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Nov 02 03:46:10.773304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 655/1316] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:11.784962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:11.787104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:11.793387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:11.793861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:11.794295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:11.794978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:11.795422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:11.795840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:11.824848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-644bf80d-3361-49a7-a760-35234daa15fc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Nov 02 03:46:11.825385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 662/1317] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:12.837773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:12.839926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:12.846284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:12.846764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:12.847201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:12.847894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:12.848379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:12.848810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:12.878967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d04a7891-129b-46a9-91a1-0dd2dcd1bae1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045731 Nov 02 03:46:12.879526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 656/1318] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:46:13.891645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:13.893762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:13.900572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:13.901045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:13.901477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:13.902158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:13.902611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:13.903038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:13.931989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18e96048-6d17-4890-af23-167f6ea1e7f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Nov 02 03:46:13.932555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 663/1319] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:14.944436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:14.946589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:14.952926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:14.953409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:14.953846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:14.954534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:14.954985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:14.955407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:14.984198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-999b6bad-dbaa-4e72-b2aa-3efc521160db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Nov 02 03:46:14.984743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 657/1320] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:15.997071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:15.999226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:16.005797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:16.006269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:16.006700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:16.007383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:16.007831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:16.008289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:16.010586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:16.038436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c3da2135-fc4c-474d-ba70-fc87ae180507 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Nov 02 03:46:16.038971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 664/1321] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:17.051146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:17.054832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:17.057110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:17.062476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:17.062956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:17.063386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:17.064092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:17.064538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:17.064955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:17.067238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:17.094812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-27a410a5-40d3-4e9d-9002-81bee588825e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047849 Nov 02 03:46:17.095358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 658/1322] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:18.107322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:18.109585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:18.116114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:18.116594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:18.117031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:18.117721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:18.118172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:18.118610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:18.148612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0e9f00a6-422c-49d1-9452-19e67eca71df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Nov 02 03:46:18.149154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 665/1323] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:19.161018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:19.163740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:19.170424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:19.170898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:19.171329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:19.172041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:19.172492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:19.172913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:19.202181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2a93d050-9551-4eb1-be40-d439aa4da80a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Nov 02 03:46:19.202722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 659/1324] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:20.214614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:20.216833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:20.223198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:20.223672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:20.224146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:20.224836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:20.225788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:20.226212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:20.256236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-36f0b0fe-58a1-496c-b52d-d61569253a0c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Nov 02 03:46:20.256802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 666/1325] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:21.268484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:21.270632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:21.276993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:21.277469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:21.277902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:21.278579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:21.279025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:21.279445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:21.308406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-30f9495d-d434-4f61-be9d-ba5d362af279 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Nov 02 03:46:21.308944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 660/1326] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:22.320251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:22.322333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:22.328710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:22.329188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:22.329623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:22.330307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:22.330756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:22.331178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:22.360621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d91f2f5f-51f6-402c-8a76-9c3456e3eab0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Nov 02 03:46:22.361168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 667/1327] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:23.373659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:23.376035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:23.382403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:23.382877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:23.383307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:23.384004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:23.384454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:23.384871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:23.413984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d14bc8af-7e5a-422d-9196-b1e19beb8ce0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Nov 02 03:46:23.414533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 661/1328] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:24.426289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:24.428497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:24.435121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:24.435599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:24.436070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:24.436763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:24.437222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:24.437652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:24.466712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b76d9260-607e-4391-b67a-dcbdc5d69eea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Nov 02 03:46:24.467303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 668/1329] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:25.479505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:25.481615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:25.487965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:25.488453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:25.488888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:25.489572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:25.490022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:25.490444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:25.519374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-459eae43-163a-42da-9f0c-8c4ed65704b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Nov 02 03:46:25.519908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 662/1330] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:26.530666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:26.532884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:26.539387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:26.539807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:26.540330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:26.541027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:26.541479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:26.541903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:26.572475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d4cd0f15-973d-493b-84c5-17e57110ecac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Nov 02 03:46:26.573017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 669/1331] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:27.585079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:27.587298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:27.593263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:27.593773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:27.594213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:27.594898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:27.595417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:27.595792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:27.625269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9fe53057-cc79-4359-8567-a7876c6ef1cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Nov 02 03:46:27.625813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 663/1332] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:28.638057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:28.640238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:28.646543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:28.647018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:28.647447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:28.648192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:28.648637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:28.649054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:28.677634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-095a4cc3-6fb1-4843-a291-774cdbfd9d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Nov 02 03:46:28.678109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 670/1333] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:29.690481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:29.692669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:29.699112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:29.699593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:29.700057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:29.700746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:29.701197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:29.701621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:29.731020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84156cf3-0b69-4f12-b2c0-9afa276b065c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Nov 02 03:46:29.731500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 664/1334] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:30.742531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:30.744863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:30.751490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:30.751989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:30.752428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:30.753106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:30.753552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:30.753966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:30.783386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-30fba25c-884d-4e08-bce2-51a08f3372fb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Nov 02 03:46:30.783920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 671/1335] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:31.795711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:31.797827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:31.804203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:31.804706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:31.805130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:31.805821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:31.806275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:31.806702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:31.836185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3ac158e8-225e-4c57-9a08-17581a07bb0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Nov 02 03:46:31.836725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 665/1336] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:32.848735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:32.851355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:32.857880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:32.858479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:32.859186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:32.859710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:32.860189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:32.860709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:32.891378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9ab67352-e106-48b3-be25-c027ad0811eb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Nov 02 03:46:32.892007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 672/1337] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:33.903769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:33.905979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:33.912217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:33.912690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:33.913634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:33.914306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:33.914751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:33.915197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:33.944632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f44c31bc-9482-47c0-bf7e-c04d3615f46f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Nov 02 03:46:33.945193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 666/1338] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:34.956937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:34.959146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:34.965493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:34.965963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:34.966392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:34.967067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:34.967511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:34.967929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:34.996735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-88e44f75-e5ec-4dcb-afc3-0be266eac47c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Nov 02 03:46:34.997273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 673/1339] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:36.009959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:36.013103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:36.020992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:36.021476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:36.021918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:36.022617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:36.023075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:36.024193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:36.052639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-90496ee0-53aa-4365-bbc6-02d6f672905f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Nov 02 03:46:36.053184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 667/1340] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:37.065118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:37.067728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:37.074235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:37.074714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:37.075150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:37.075872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:37.076349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:37.076771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:37.107142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5ef8f14e-4999-476d-9f6b-2087bac3583d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Nov 02 03:46:37.107700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 674/1341] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:38.119407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:38.121680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:38.128355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:38.128886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:38.129258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:38.129947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:38.130427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:38.130853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:38.162110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-929aa283-5b81-443d-8bd6-bed59b046b49 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Nov 02 03:46:38.162593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 668/1342] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:39.174271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:39.176485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:39.183227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:39.183699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:39.184167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:39.184846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:39.185294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:39.185712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:39.215022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f5b162b3-bf22-4aa3-8131-c1c5d8f4d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Nov 02 03:46:39.215572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 675/1343] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:40.227360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:40.229538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:40.235895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:40.236400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:40.236829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:40.237510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:40.237956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:40.238376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:40.267415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9be6b535-3b3d-4baf-9be1-41e71870b7ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Nov 02 03:46:40.267976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 669/1344] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:41.280469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:41.282565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:41.284909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:41.290205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:41.290679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:41.291110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:41.291793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:41.292272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:41.292692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:41.322524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1155dd20-eb77-422a-994c-e3e1497eff57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Nov 02 03:46:41.323069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 676/1345] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:46:42.334655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:42.337375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:42.343797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:42.344312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:42.344745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:42.345426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:42.345874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:42.346293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:42.375284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1ccb1c72-e33e-434b-83c5-f50b7c5670c3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Nov 02 03:46:42.375822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 670/1346] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:43.387176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:43.389410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:43.395881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:43.396396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:43.396833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:43.397527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:43.398014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:43.398482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:43.427585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a248f553-6c61-4d99-97b3-d41b6598de57 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Nov 02 03:46:43.428163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 677/1347] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:44.440775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:44.442902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:44.449763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:44.450243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:44.450682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:44.451375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:44.451830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:44.452291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:44.480849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4b83083a-2b00-4f85-80a9-ee8ab989f694 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Nov 02 03:46:44.481390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 671/1348] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:45.493202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:45.495413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:45.501924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:45.502399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:45.502836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:45.503523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:45.503989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:45.504411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:45.534555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1fd29dba-aab0-47d1-bf6d-82de2639ce66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Nov 02 03:46:45.535129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 678/1349] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:46.548030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:46.550245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:46.557354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:46.557829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:46.558264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:46.558950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:46.559402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:46.560033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:46.589007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af9c7dfb-accc-40a7-9b8c-c6f634df8010 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Nov 02 03:46:46.589557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 672/1350] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:47.601558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:47.603796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:47.610214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:47.610758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:47.611313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:47.612122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:47.612580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:47.612999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:47.615373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:47.644430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-13b33fe1-f918-4671-b98b-515954fd2b51 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Nov 02 03:46:47.645009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 679/1351] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:48.657096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:48.659240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:48.662539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:48.666776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:48.667264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:48.667700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:48.668424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:48.668878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:48.669305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:48.671852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:46:48.699514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8c66a9cd-dac8-4eb5-9ee2-49b2010d70d0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Nov 02 03:46:48.700003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 673/1352] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:49.711655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:49.714495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:49.720902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:49.721384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:49.721820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:49.722511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:49.722961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:49.723501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:49.752843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ebaf7d90-8491-4bf7-bdb4-4231f1ae1628 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Nov 02 03:46:49.753393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 680/1353] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:46:50.765624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:50.767772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:50.774225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:50.774710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:50.775170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:50.775851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:50.776341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:50.776775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:50.805842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ffc4ce9-09eb-4dbe-a51c-1cf87f5dc1f8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Nov 02 03:46:50.806895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 674/1354] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:51.818674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:51.820925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:51.827714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:51.828224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:51.828664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:51.829343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:51.829821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:51.830244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:51.859406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d193f775-fa71-444a-b7fc-39bf3c643cbb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Nov 02 03:46:51.859968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 681/1355] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:52.871145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:52.873331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:52.879980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:52.880471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:52.880910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:52.881926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:52.882388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:52.882812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:52.911753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a2d0b75e-d929-4cbc-8682-db85fde0469c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Nov 02 03:46:52.912318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 675/1356] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:53.924205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:53.926356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:53.932212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:53.932690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:53.933118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:53.933804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:53.934245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:53.934659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:53.964251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e97b25c8-7747-409c-a9e0-d4e146151659 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Nov 02 03:46:53.964804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 682/1357] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:54.976947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:54.979821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:54.987172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:54.987657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:54.988133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:54.988829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:54.989280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:54.989707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:55.019116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bbc9f12a-f645-4433-bf45-f769cedb3666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Nov 02 03:46:55.019659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 676/1358] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:56.031001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:56.033232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:56.039711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:56.040253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:56.041185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:56.041882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:56.042339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:56.042771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:56.072241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d1b8c53d-5aa3-45a2-8074-e3d2df3caf01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Nov 02 03:46:56.072796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 683/1359] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:57.083362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:57.085602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:57.092560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:57.093042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:57.093479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:57.094190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:57.094624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:57.095047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:57.125210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-35ae92ec-6555-47c7-b631-968893707568 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Nov 02 03:46:57.125758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 677/1360] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:46:58.137663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:58.139862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:58.146296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:58.146780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:58.147214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:58.147903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:58.148379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:58.148803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:58.179654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c040fbc-a4bb-4136-8172-e1d8bbd0a92b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Nov 02 03:46:58.180227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 684/1361] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:46:59.192250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:46:59.196186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:46:59.201998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:59.202470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:59.202900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:59.203582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:46:59.204082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:46:59.204503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:46:59.236660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7917f246-08f0-4afe-af91-2d2eca2be40c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048660 Nov 02 03:46:59.237216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 678/1362] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:46:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:00.251838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:00.254086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:00.261257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:00.261790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:00.262126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:00.262818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:00.263263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:00.263683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:00.292830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f0c541b4-4cda-4af6-9411-829ba48e90ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047286 Nov 02 03:47:00.293383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 685/1363] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:01.305368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:01.308264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:01.315313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:01.315796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:01.316288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:01.316986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:01.317441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:01.317896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:01.349135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e6db42fd-c56a-48ee-9ba0-0edd43c6378a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Nov 02 03:47:01.349688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 679/1364] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:02.361036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:02.363511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:02.370964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:02.371522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:02.372056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:02.372823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:02.373344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:02.373852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:02.403788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f07c487f-c420-4fd6-9123-6d5499cd1e4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Nov 02 03:47:02.404370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 686/1365] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:03.415955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:03.418286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:03.434252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:03.434744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:03.435182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:03.435914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:03.436394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:03.436821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:03.466470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9b38225e-b870-4751-8cab-9468ca69986f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054562 Nov 02 03:47:03.467015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 680/1366] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:04.479027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:04.481453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:04.487517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:04.488027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:04.488471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:04.489168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:04.489622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:04.490046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:04.520111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4c13c556-a96a-4a43-938c-af11027d8d94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Nov 02 03:47:04.520663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 687/1367] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:05.532564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:05.535362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:05.541445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:05.541932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:05.542367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:05.543069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:05.543521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:05.543964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:05.574706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b169a9e8-b150-4bca-a8bd-ba79af3a1530 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046255 Nov 02 03:47:05.575267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 681/1368] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:06.586645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:06.589459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:06.595748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:06.596250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:06.596741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:06.597441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:06.597885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:06.598303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:06.628663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d80a665d-28b3-4415-ad17-b852be6ee46e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045926 Nov 02 03:47:06.629518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 688/1369] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:07.640380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:07.642654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:07.650575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:07.651059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:07.651491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:07.652200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:07.652649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:07.653097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:07.684912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6be2dca3-3524-4d22-a68e-84effcb15bee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Nov 02 03:47:07.685469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 682/1370] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:08.697312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:08.699599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:08.705959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:08.706445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:08.706880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:08.707582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:08.708085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:08.708514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:08.738739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-890864fd-31c6-4749-974a-5b575d23b51e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Nov 02 03:47:08.739296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 689/1371] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:09.751444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:09.753735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:09.760009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:09.760489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:09.760978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:09.761665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:09.762115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:09.762538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:09.796761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6e2ee5d9-11a9-432a-b822-d0b36fa2aaf2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049462 Nov 02 03:47:09.797312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 683/1372] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:10.809574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:10.811774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:10.814805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:47:10.814946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:47:10.822467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:10.822952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:10.824070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:10.825007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:10.825465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:10.825994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:10.859899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-db2e8ad5-6450-4492-8686-4144af012a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054702 Nov 02 03:47:10.860486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 690/1373] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:11.872378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:11.874915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:11.881272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:11.881784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:11.882222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:11.882912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:11.883365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:11.883786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:11.914732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ded1612-ba1a-4db0-b514-4c0f1c827733 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Nov 02 03:47:11.915285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 684/1374] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:12.926997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:12.929188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:12.931525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=30 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:12.936924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:12.937405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:12.937839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:12.938528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:12.938971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:12.939390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:12.974686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d7660a82-1600-4102-9fb1-fb7f488c46a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051564 Nov 02 03:47:12.975253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 691/1375] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:13.986880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:13.989221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:13.995770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:13.996289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:13.996728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:13.997421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:13.997910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:13.998331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:14.033827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-feda938c-fa94-428d-ad16-1d3f5d167652 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050924 Nov 02 03:47:14.034381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 685/1376] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:15.046543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:15.048776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:15.055050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:15.055530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:15.055985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:15.056686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:15.057157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:15.057560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:15.088771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8b22dbd2-3afb-412a-b03a-5b6f62abb3b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Nov 02 03:47:15.089940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 692/1377] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:16.100624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:16.103002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:16.109310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:16.109796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:16.110231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:16.110914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:16.111365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:16.111785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:16.152012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4ba2bfeb-61bf-47ff-971a-26b6eaa340a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055179 Nov 02 03:47:16.152573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 686/1378] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:17.164358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:17.166519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:17.172913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:17.173476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:17.173919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:17.174613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:17.175067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:17.175488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:17.207379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9147b292-048a-482f-bd36-0d63cec3852c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046950 Nov 02 03:47:17.208247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 693/1379] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:18.218533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:18.221065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:18.227378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:18.227702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:18.228177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:18.228863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:18.229310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:18.229738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:18.260430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-428f2212-f185-4ed2-9f8a-30de2576a15f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Nov 02 03:47:18.261891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 687/1380] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:19.273694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:19.275885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:19.283031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:19.283520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:19.284645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:19.285361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:19.285814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:19.286241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:19.290102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=90 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:19.317314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6e9f8a79-c7b5-463a-b3a5-4f84a64f16b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Nov 02 03:47:19.319387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 694/1381] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:20.330123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:20.333223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:20.336549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:20.340933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:20.341414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:20.341917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:20.342725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:20.343246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:20.343726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:20.347594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=90 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:20.375895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f9b186ed-9033-4a98-91b5-643ca053eb63 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050354 Nov 02 03:47:20.376495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 688/1382] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:21.389121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:21.391592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:21.398172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:21.398722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:21.399159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:21.399853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:21.400322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:21.400742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:21.431878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-89fc4f04-c2ca-4369-9db5-58e057f13569 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Nov 02 03:47:21.432467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 695/1383] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:22.444013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:22.446199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:22.452788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:22.453410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:22.453821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:22.454405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:22.454860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:22.455288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:22.485762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fc19e032-14f9-47ab-8e77-9355026ad2a6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Nov 02 03:47:22.486306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 689/1384] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:23.498587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:23.501413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:23.507589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:23.508099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:23.508531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:23.509210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:23.509654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:23.510071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:23.541471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-96d401c4-c24b-476e-b998-97a2bf5af9fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047341 Nov 02 03:47:23.542316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 696/1385] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:24.554097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:24.556294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:24.562892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:24.563377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:24.563937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:24.564654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:24.565104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:24.565529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:24.597325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bd227f29-c3cc-42ed-a6f0-a50cca4aaf54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047408 Nov 02 03:47:24.598079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 690/1386] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:25.609566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:25.611735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:25.618111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:25.618562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:25.619013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:25.619708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:25.620239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:25.620664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:25.650683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-765a9605-b982-4a57-a638-86b58714d9a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Nov 02 03:47:25.651849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 697/1387] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:26.662614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:26.664810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:26.671486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:26.671974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:26.672415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:26.673096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:26.673539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:26.673956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:26.704512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0021b9a2-fcbc-4617-b936-37073588e1c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Nov 02 03:47:26.705010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 691/1388] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:27.717306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:27.719516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:27.726119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:27.726878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:27.727323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:27.728032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:27.728479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:27.728895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:27.760138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ac7d378f-5210-4bac-9d64-05934fc34133 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047300 Nov 02 03:47:27.761207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 698/1389] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:28.772846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:28.774988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:28.781021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:28.781499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:28.781934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:28.782615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:28.783059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:28.783481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:28.813606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f100a79e-2b0f-4255-b3db-c1bdfe14d13d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Nov 02 03:47:28.814153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 692/1390] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:29.825776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:29.827924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:29.834160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:29.834637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:29.835070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:29.835757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:29.836229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:29.836654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:29.866746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4bb92f55-999f-4375-9d8b-9c618f4d5d0d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Nov 02 03:47:29.867297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 699/1391] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:30.878592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:30.880787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:30.887720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:30.888231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:30.888674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:30.889372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:30.889829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:30.890258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:30.919463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-958f94d6-ec27-497b-aa74-67a3e31bfada tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Nov 02 03:47:30.920194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 693/1392] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:31.932078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:31.934414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:31.942491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:31.942972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:31.943410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:31.944148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:31.944591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:31.945011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:31.976613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-045f2439-afcb-4aed-943a-0cc07ba241d5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Nov 02 03:47:31.977177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 700/1393] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:32.989487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:32.991705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:32.998361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:32.998848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:32.999284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:33.000287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:33.000734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:33.001157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:33.033368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d3bb33dc-f25b-4f4e-9afe-1160846d91fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Nov 02 03:47:33.034281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 694/1394] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:34.045907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:34.048075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:34.054481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:34.054958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:34.055418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:34.056133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:34.056838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:34.057773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:34.088256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d87f2427-7f54-4875-bccb-4182a915ac6e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Nov 02 03:47:34.088820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 701/1395] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:35.100324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:35.102468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:35.109107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:35.109586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:35.110022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:35.110702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:35.111150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:35.111568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:35.142026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b7df16a-b7b0-46b3-86b3-ea9e6bf90c92 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Nov 02 03:47:35.142587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 695/1396] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:36.154721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:36.156920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:36.163232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:36.163711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:36.164183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:36.164873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:36.165326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:36.165753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:36.195498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a35c944e-9b85-48ae-9200-dcbc65c7f8a7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Nov 02 03:47:36.196094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 702/1397] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:37.208581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:37.210715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:37.217184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:37.217662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:37.218097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:37.218781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:37.219233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:37.219657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:37.249497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e6b10bc2-3972-4052-95a7-b6e39ebbf778 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Nov 02 03:47:37.250495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 696/1398] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:38.262394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:38.264725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:38.270971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:38.271442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:38.271873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:38.272580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:38.273027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:38.273442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:38.305992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-29f8881d-87c9-4fcb-be13-cd1a842abc44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Nov 02 03:47:38.306767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 703/1399] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:39.318702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:39.320857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:39.327163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:39.327640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:39.328097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:39.328778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:39.329224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:39.329640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:39.360109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d1e9a760-2982-47e3-a05e-8dba8dad8936 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Nov 02 03:47:39.360665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 697/1400] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:40.371803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:40.374001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:40.380719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.381199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.381639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.382341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.382796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.383228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.413008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-34cdb9e6-02d6-49cb-86b3-b70aa492652c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Nov 02 03:47:40.413571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 704/1401] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:40.472266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:40.472773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:40.479775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.479892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.480305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.481005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.481461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.482169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.507786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:47:40.586874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-52a4bf15-d5bc-45d5-9a76-dcd48f814652 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 204 len: 0 microversion: 2.1 time: 0.118302 Nov 02 03:47:40.587675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 698/1402] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:47:40 2022] DELETE /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:47:40.596526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:40.597163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:40.602899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.603371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.603800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.604505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:40.604975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:40.605394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:40.784133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:40.792232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77e5bb3e-e388-423e-8d31-4f7b9f25c4e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.200035 Nov 02 03:47:40.792789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 705/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:41.426176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:41.428504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:41.434276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:41.434760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:41.435204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:41.435898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:41.436374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:41.436801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:41.468242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-46b4a572-f2e1-47b0-ac76-2690d11e646d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Nov 02 03:47:41.468890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 699/1404] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:41.815123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:41.815645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:41.821910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:41.822387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:41.822816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:41.824038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:41.824490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:41.824935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:41.949714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:41.957906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7aefef8f-f650-4c3c-9a37-cfb7486f4871 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146765 Nov 02 03:47:41.958466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 706/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:42.481186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:42.483283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:42.489585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:42.490052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:42.490479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:42.491150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:42.491595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:42.492047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:42.521035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7fef4493-6b29-4bf6-a83e-26195ae6be0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Nov 02 03:47:42.521567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 700/1406] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:42.981916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:42.982532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:42.984884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=32 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:42.990250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:42.990731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:42.991166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:42.991856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:42.992332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:42.992757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:43.123763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:43.132570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7e6f2df2-7e92-40b0-9a32-f9752109fc05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.155078 Nov 02 03:47:43.133285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 707/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:42 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:43.533901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:43.536090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:43.542568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:43.543046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:43.543480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:43.544200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:43.544656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:43.545077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:43.574508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7850bbc9-a0d0-471a-b3a6-3b620cd86cc7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Nov 02 03:47:43.575060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 701/1408] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:44.155126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:44.155742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:44.162065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:44.162542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:44.162980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:44.163669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:44.164162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:44.164586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:44.300458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:44.309435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e39ce12e-87b4-4432-82e7-666feda1062a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.158688 Nov 02 03:47:44.310009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 708/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:44.586728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:44.589076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:44.595481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:44.595982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:44.596431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:44.597139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:44.597593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:44.598015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:44.627323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e925cd98-798e-4a2e-8542-ebc19f10b71d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Nov 02 03:47:44.627873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 702/1410] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:45.332714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:45.333366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:45.340254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:45.340734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:45.341169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:45.341861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:45.342310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:45.342732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:45.499587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:45.508626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5f97c721-a03c-4f55-ad4c-1bb3426d8a54 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.179785 Nov 02 03:47:45.509198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 709/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:45.638552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:45.640681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:45.646902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:45.647377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:45.647806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:45.648542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:45.648989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:45.649474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:45.653092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:45.681174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c799e6d6-305e-4190-926e-4a5ceccec1ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Nov 02 03:47:45.681727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 703/1412] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:46.532806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:46.533540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:46.540041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:46.540517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:46.540956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:46.541638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:46.542081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:46.542498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:46.668262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:46.670403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:46.677573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1cc28f08-696b-4995-8718-204ca00cdd2e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149041 Nov 02 03:47:46.678134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 710/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:47:46.694078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:46.696331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:46.703277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:46.703757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:46.704336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:46.705050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:46.705501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:46.705932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:46.734071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c77eabd8-6828-49df-852a-bdd4ed90bf3a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Nov 02 03:47:46.734612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 704/1414] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:47.701218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:47.701825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:47.708107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:47.708585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:47.709017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:47.709689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:47.710162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:47.710578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:47.746391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:47.748472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:47.755050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:47.755533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:47.755981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:47.756684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:47.757135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:47.757562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:47.787761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a03272fb-fef1-4bf3-bc53-245f7d4769b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Nov 02 03:47:47.788538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 705/1415] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:47:47.843486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:47.851682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-81f78f1f-f1e8-406a-b1d2-c79e11e45df7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154799 Nov 02 03:47:47.852279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 711/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:48.799302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:48.801379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:48.807615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:48.808121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:48.808556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:48.809822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:48.810275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:48.810694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:48.839277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b5f31bc5-460f-4afa-aa2c-85ca637a9155 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Nov 02 03:47:48.839811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 706/1417] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:48.874615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:48.875472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:48.881833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:48.882309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:48.882764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:48.883446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:48.883888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:48.884335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:49.009392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:49.018044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d7cb94d8-ba87-4735-94c6-f3c49e994c86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147753 Nov 02 03:47:49.018600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 712/1418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:49.851931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:49.854054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:49.860949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:49.861421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:49.861847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:49.862527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:49.862973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:49.863392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:49.891953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63029848-e6ce-4119-be22-6c1f1f76b7f3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Nov 02 03:47:49.892509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 707/1419] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:50.040732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:50.041340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:50.047603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:50.048110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:50.048540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:50.049214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:50.049659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:50.050078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:50.180021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:50.188199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-10540a66-6368-4bff-8660-ee6cbd61a4f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151272 Nov 02 03:47:50.188758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 713/1420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:50 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:50.904551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:50.906674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:50.908978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:50.914892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:50.915371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:50.915805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:50.916511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:50.916959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:50.917379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:50.948005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b687fc75-78cc-4a48-b629-3663d49fd76b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Nov 02 03:47:50.948563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 708/1421] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:51.210798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:51.211521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:51.218834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:51.219312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:51.219741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:51.220465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:51.220915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:51.221336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:51.354830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:51.365435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-186052c7-02c8-4b42-b979-0c226b3bcd7e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.158291 Nov 02 03:47:51.366491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 714/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:51.960386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:51.962552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:51.969565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:51.970040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:51.970466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:51.971150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:51.971598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:51.972083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:52.001386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fa09ac65-66f7-4808-b7e0-e0df1b4c83ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Nov 02 03:47:52.001925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 709/1423] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:52.389874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:52.390435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:52.396838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:52.397315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:52.397746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:52.398426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:52.398868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:52.399282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:52.524387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:52.533430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58caa780-4e78-4a65-891d-11c389aadfb6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148023 Nov 02 03:47:52.533999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 715/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:53.014158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:53.016274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:53.022607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:53.023088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:53.023527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:53.024234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:53.024691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:53.025121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:53.054203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f31c272b-a65b-4ed3-ab8e-225e56ea4fce tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Nov 02 03:47:53.054754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 710/1425] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:53.556628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:53.557244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:53.563666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:53.564193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:53.564632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:53.565311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:53.565759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:53.566181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:53.696239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:53.704830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d1845db2-204d-4b10-9031-15426b87b079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152061 Nov 02 03:47:53.705387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 716/1426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:54.067318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:54.069471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:54.076499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:54.076973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:54.077400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:54.078075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:54.078522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:54.078938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:54.107767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7b93f135-a70c-4fec-8a43-6b9d1a6824d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Nov 02 03:47:54.108345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 711/1427] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:54.728936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:54.729474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:54.736040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:54.736501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:54.736935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:54.737618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:54.738119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:54.738543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:54.864421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:54.873681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a85f855c-f4f5-4625-b9ba-5b9ca22ae3e9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148798 Nov 02 03:47:54.874428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 717/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:55.120264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:55.122342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:55.128941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:55.129427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:55.129863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:55.130549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:55.131002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:55.131424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:55.160208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7b374d92-2fdc-44ca-9f3a-622ca586296b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Nov 02 03:47:55.160745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 712/1429] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:55.896647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:55.897163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:55.903438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:55.903931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:55.904385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:55.905062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:55.905502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:55.905918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:56.038833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:56.047565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ef7aa023-afb7-4479-b7ae-e7b8336fcb6a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154935 Nov 02 03:47:56.048159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 718/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:56.172950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:56.175095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:56.181465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:56.181944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:56.182378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:56.183062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:56.184161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:56.184593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:56.212901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9c213c6c-701c-48a3-8ab4-b08cc281b0dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Nov 02 03:47:56.213434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 713/1431] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:57.070928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:57.071671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:57.077955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:57.078430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:57.078878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:57.079538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:57.080006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:57.080426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:57.205841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:57.213995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f655161c-3d9c-4b2d-a9f1-ac1fbe8c5290 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147339 Nov 02 03:47:57.214551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 719/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:57.225311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:57.227480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:57.234057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:57.234476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:57.234913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:57.235596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:57.236074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:57.236499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:57.264941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-82f635e9-5522-4d44-8a66-a1bd6536f7ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Nov 02 03:47:57.265481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 714/1433] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:58.236430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:58.237041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:58.243412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:58.243882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:58.244340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:58.245014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:58.245457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:58.245873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:58.276985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:58.279779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:58.286252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:58.286739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:58.287178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:58.287874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:58.288367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:58.288793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:58.318890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3b55296a-6a41-4bcc-a2c2-cfce00f70c94 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Nov 02 03:47:58.319443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 715/1434] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:47:58.371924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:58.380616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3dbad7ed-e448-47f8-b6b7-96939fda89a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148029 Nov 02 03:47:58.381254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 720/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:47:59.330811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:59.333009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:59.339360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:59.340369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:59.340810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:59.341511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:59.341964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:59.342396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:59.371470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1143ceec-b488-4840-86a0-b62a0a749bcc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Nov 02 03:47:59.371937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 716/1436] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:47:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:47:59.404871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:47:59.405492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:47:59.411930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:59.412443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:59.412895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:59.413580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:47:59.414031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:47:59.414458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:47:59.542699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:47:59.551506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-beecd240-2b3b-4c85-8af3-7e7cba989f07 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151271 Nov 02 03:47:59.552094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 721/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:47:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:00.384094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:00.386239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:00.393267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:00.393746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:00.394192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:00.394883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:00.395339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:00.395764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:00.424700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-20068933-094f-4034-bb8d-366de7a4932c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Nov 02 03:48:00.425179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 717/1438] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:00.574162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:00.574772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:00.581126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:00.581988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:00.582080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:00.582751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:00.583292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:00.583820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:00.707968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:00.715972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf16b304-1602-49a3-a1d9-c360f9e0a1cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145625 Nov 02 03:48:00.716529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 722/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:01.437024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:01.439272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:01.445510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:01.445984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:01.446415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:01.447090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:01.447540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:01.447975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:01.477074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e53341c-63e3-4773-9ea2-2e1531f19496 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Nov 02 03:48:01.477611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 718/1440] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:01.739291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:01.739796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:01.746654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:01.747127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:01.747558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:01.748267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:01.748722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:01.749141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:01.878918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:01.887675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dd0e82d2-535b-4477-bdba-c3e27391910b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152322 Nov 02 03:48:01.888271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 723/1441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:02.489355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:02.491499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:02.497915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:02.498400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:02.498844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:02.499593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:02.500334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:02.500766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:02.525337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:02.531339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8fc00c27-db18-47de-9494-2a469f3ef601 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Nov 02 03:48:02.531897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 719/1442] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:02.910759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:02.911283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:02.917708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:02.918183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:02.918618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:02.919304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:02.919757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:02.920210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:03.046594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:03.055048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0f31e369-7e34-48eb-a33f-c572232511ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148387 Nov 02 03:48:03.055614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 724/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:02 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:03.542701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:03.544858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:03.551909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:03.552425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:03.552865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:03.553555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:03.554008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:03.554435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:03.583352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce2f89aa-2485-497b-92b3-94439b4f4136 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Nov 02 03:48:03.583828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 720/1444] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:04.078316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:04.078954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:04.085294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:04.085764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:04.086192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:04.086871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:04.087313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:04.087733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:04.217033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:04.225939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4e256d93-fba4-44dc-b35d-79fd76f1d15b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151532 Nov 02 03:48:04.226493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 725/1445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:04.595358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:04.597517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:04.604104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:04.604614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:04.605054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:04.605741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:04.606207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:04.606619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:04.635663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48a72360-1d68-4f4c-b440-b1a4eea21d87 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Nov 02 03:48:04.636181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 721/1446] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:05.248748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:05.249393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:05.255998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:05.256477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:05.256906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:05.257619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:05.258065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:05.258485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:05.382128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:05.390265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dd242e08-a72c-49c0-9395-58fa1f2a03f1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145393 Nov 02 03:48:05.390830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 726/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:05.648601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:05.650772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:05.657719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:05.658204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:05.658642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:05.659334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:05.659797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:05.660252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:05.688606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5eaee91a-9a43-4594-9889-c142a061d949 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Nov 02 03:48:05.689147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 722/1448] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:06.413803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:06.414410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:06.420902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:06.421377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:06.421812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:06.422605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:06.423058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:06.423473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:06.437568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:06.554866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:06.563056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-387b3bb9-e5d2-464e-a543-362146a39467 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153220 Nov 02 03:48:06.563607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 727/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:06.700859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:06.703577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:06.709903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:06.710379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:06.710815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:06.711534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:06.712010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:06.712436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:06.742053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-47a4984a-ba23-4c76-9079-1d43ea71f2f5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 Nov 02 03:48:06.742600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 723/1450] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:07.586462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:07.587074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:07.593931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:07.594411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:07.594842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:07.595522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:07.595973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:07.596395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:07.729688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:07.738567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-27c89d60-7a4b-419a-8f88-07bd169bc645 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.155960 Nov 02 03:48:07.739138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 728/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:07.754380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:07.756551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:07.762779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:07.763255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:07.763687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:07.764397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:07.764874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:07.765293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:07.793888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9deb0aa-7471-4896-a172-d6d56e5dd33b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Nov 02 03:48:07.794356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 724/1452] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:08.761612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:08.762222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:08.768658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:08.769135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:08.769567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:08.770255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:08.770703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:08.771126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:08.806517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:08.808680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:08.815701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:08.816220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:08.816654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:08.817356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:08.817805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:08.818222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:08.847259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-91cad57b-c5a4-48a5-b638-1d79c806d2e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Nov 02 03:48:08.847814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 725/1453] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:08.900241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:08.908438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc47f1b4-b4a0-44c1-b9e9-0b77b4816382 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150586 Nov 02 03:48:08.908996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 729/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:08 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:09.859774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:09.861930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:09.868330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:09.868804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:09.869235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:09.869915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:09.870361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:09.870780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:09.900113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7f57094b-3f46-4e88-837d-b653b0a84f7a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Nov 02 03:48:09.900645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 726/1455] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:09.931569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:09.932315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:09.939070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:09.939546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:09.939998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:09.940686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:09.941137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:09.941558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:10.070420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:10.079473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-062854c8-766d-4448-b037-97d4204ce6f8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151734 Nov 02 03:48:10.080055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 730/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:09 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:10.912418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:10.914627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:10.921476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:10.921960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:10.922395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:10.923081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:10.923535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:10.923971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:10.952850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ef7dbf53-0fb5-4c99-bddd-183f2c1a67cb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Nov 02 03:48:10.953386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 727/1457] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:11.101729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:11.102340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:11.109584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:11.110060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:11.110492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:11.111168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:11.111611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:11.112053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:11.237215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:11.245342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2680fde9-8e42-4939-af32-00ae3f538980 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147474 Nov 02 03:48:11.245895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 731/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:11.965103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:11.967643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:11.974665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:11.975152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:11.975593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:11.976353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:11.976812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:11.977241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:12.006766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-94a22004-69c8-4e07-a030-084f0790ded3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Nov 02 03:48:12.007488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 728/1459] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:12.267817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:12.268451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:12.274743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:12.275216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:12.275646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:12.276352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:12.276793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:12.277206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:12.401635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:12.410343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0b2cd355-4979-4f32-9155-9555230acefb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146351 Nov 02 03:48:12.410905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 732/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:13.019266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:13.021548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:13.027993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:13.028490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:13.028930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:13.029620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:13.030104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:13.030531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:13.059151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6b5bf6b7-d578-47eb-808f-ab76d6ff88bd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Nov 02 03:48:13.059702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 729/1461] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:13.432447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:13.432966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:13.435433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:13.441236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:13.441713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:13.442144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:13.442840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:13.443273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:13.443691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:13.572257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:13.580391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8f91bc45-7475-41d4-8d14-7cde72a34cae tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151793 Nov 02 03:48:13.580950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 733/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:14.071812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:14.073961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:14.080783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:14.081253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:14.081682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:14.082360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:14.082808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:14.083228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:14.112184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-890dd846-fc5a-456c-aeb5-e8ed4a1b6e5d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Nov 02 03:48:14.112737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 730/1463] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:14.603823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:14.604463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:14.611096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:14.611569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:14.612025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:14.612764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:14.613210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:14.613627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:14.736328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:14.744412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a17dacab-563a-4a18-b36b-04351a7dad86 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144469 Nov 02 03:48:14.744970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 734/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:15.125221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:15.127382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:15.133803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:15.134275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:15.134706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:15.135390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:15.135847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:15.136296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:15.164995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-42623831-d886-4468-bb5d-7dddd2935d88 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Nov 02 03:48:15.165538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 731/1465] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:15.767780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:15.768427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:15.774827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:15.775310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:15.775750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:15.776470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:15.776921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:15.777375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:15.904952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:15.913931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9550e546-148b-4054-9053-ad510107b00d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150265 Nov 02 03:48:15.914495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 735/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:15 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:16.177246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:16.179452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:16.185792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:16.186270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:16.186705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:16.187392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:16.187842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:16.188300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:16.217038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eff016f6-3d57-4b62-a56a-3556f3926e0b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Nov 02 03:48:16.217572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 732/1467] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:16.937547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:16.938079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:16.944438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:16.944917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:16.945357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:16.946047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:16.946503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:16.946930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:17.076658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:17.085040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5c4fe7cd-2e4f-4f5d-ae00-0deb0c8c847a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151961 Nov 02 03:48:17.085603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 736/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:16 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:17.229738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:17.231862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:17.238898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:17.239383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:17.239821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:17.240542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:17.240994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:17.241420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:17.270616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71b08713-c2a6-4ce4-8bde-3f72862d5bf0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Nov 02 03:48:17.271164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 733/1469] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:18.107722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:18.108428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:18.114870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:18.115346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:18.115791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:18.116516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:18.116968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:18.117392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:18.251395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:18.259718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-392bdf50-fc4d-4d9b-af03-02fe1a8183c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.155934 Nov 02 03:48:18.260293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 737/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:18.282578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:18.285395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:18.291517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:18.292050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:18.292490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:18.293185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:18.293638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:18.294091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:18.323523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2042819d-3fac-471f-b0ab-588ab0006fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Nov 02 03:48:18.324110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 734/1471] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:19.283032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:19.283641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:19.290072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:19.290581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:19.291014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:19.291702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:19.292184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:19.292610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:19.336423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:19.338571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:19.345476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:19.345955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:19.346387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:19.347078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:19.347525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:19.347944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:19.377987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b499d097-0944-4c8c-b766-045bdd1fb508 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Nov 02 03:48:19.378553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 735/1472] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:19.420843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:19.429012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0649a90f-9ec7-418c-bbf7-7a4033269ede tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150307 Nov 02 03:48:19.429570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 738/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:20.390191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:20.392406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:20.398779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:20.399253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:20.399682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:20.400399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:20.400841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:20.401258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:20.415011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:20.431300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68043cd7-4141-4db2-b5c2-4193cb55f2cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Nov 02 03:48:20.431842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 736/1474] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:20.451634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:20.452296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:20.458566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:20.459044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:20.459481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:20.460432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:20.460885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:20.461307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:20.588327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:20.597503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-11544074-7f15-41a2-971e-5ad8759f99d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149702 Nov 02 03:48:20.598072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 739/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:21.443395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:21.445646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:21.447892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:21.453222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:21.453698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:21.454128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:21.454807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:21.455254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:21.455670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:21.484494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce14b0d0-0f06-4df1-8c1c-819ef0123656 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Nov 02 03:48:21.485030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 737/1476] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:21.620288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:21.620838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:21.628058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:21.628535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:21.628970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:21.629687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:21.630138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:21.630561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:21.757954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:21.766127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-db3a19e4-4578-4884-8e73-339b7ebd5ba5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149789 Nov 02 03:48:21.766686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 740/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:48:22.496581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:22.499278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:22.505848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:22.506321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:22.506751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:22.507432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:22.507878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:22.508325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:22.538221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-397f3f8c-84f5-4778-b4a9-ed324df28897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Nov 02 03:48:22.538768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 738/1478] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:22.789222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:22.789836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:22.796206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:22.796679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:22.797110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:22.797795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:22.798244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:22.798663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:22.926514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:22.934587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae8a0dde-08d4-4225-8db3-46ac4cd2c940 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149211 Nov 02 03:48:22.935148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 741/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:22 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:23.551125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:23.553290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:23.559611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:23.560135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:23.560576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:23.561263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:23.561716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:23.562139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:23.590959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5c9cb4f7-60c7-4d4d-af7d-1473bcef3245 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Nov 02 03:48:23.591501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 739/1480] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:23.958684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:23.959323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:23.965264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:23.965744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:23.966175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:23.966856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:23.967337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:23.968399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:24.099636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:24.108164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dc1b007c-0585-4f02-9a54-0a487914ba18 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153088 Nov 02 03:48:24.108759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 742/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:23 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:24.603999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:24.606194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:24.612779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:24.613263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:24.613701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:24.614395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:24.614843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:24.615271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:24.644372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-52c9817e-64c6-4229-8a55-8ce90ce2934b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Nov 02 03:48:24.644916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 740/1482] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:25.130783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:25.131507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:25.137890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:25.138303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:25.138728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:25.139407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:25.139842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:25.140286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:25.264603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:25.273184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-887ecb4a-27d2-4aaa-ab9b-d6c6474aa8c9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146249 Nov 02 03:48:25.273737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 743/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:25.656446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:25.658595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:25.665007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:25.665493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:25.665932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:25.666624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:25.667076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:25.667502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:25.696298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f4bc7a86-2e57-497f-9659-88d62efe8617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Nov 02 03:48:25.696837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 741/1484] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:26.296605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:26.297874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:26.304551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:26.305035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:26.305473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:26.306170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:26.306623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:26.307052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:26.310966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:26.431462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:26.439647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-56884690-0052-4314-963a-64c7f6433066 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146891 Nov 02 03:48:26.440241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 744/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:26.709549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:26.711738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:26.718189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:26.718674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:26.719686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:26.720415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:26.720870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:26.721303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:26.749656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b4718b4-8845-4efb-91e1-9643eb065db8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Nov 02 03:48:26.750496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 742/1486] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:27.462433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:27.463055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:27.469387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:27.469859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:27.470291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:27.470970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:27.471411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:27.471828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:27.600643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:27.608813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce802036-9837-40a9-9338-fca50920895e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150278 Nov 02 03:48:27.609377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 745/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:27.762130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:27.764619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:27.770654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:27.771137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:27.771571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:27.772285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:27.772885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:27.773203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:27.802632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-26bd5222-549d-4e24-8019-faa34bd3fa58 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Nov 02 03:48:27.803181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 743/1488] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:28.632253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:28.632871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:28.639482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:28.639975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:28.640436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:28.641798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:28.642249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:28.642702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:28.777271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:28.785684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce0a5fb7-25e1-45bc-a606-c34228ef628d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.157336 Nov 02 03:48:28.786250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 746/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:28.815089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:28.817285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:28.823501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:28.824001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:28.824438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:28.825124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:28.825574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:28.825994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:28.854563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9c8c2d7d-f3b8-499e-99e9-d8cdb5de2d28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Nov 02 03:48:28.855099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 744/1490] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:29.809086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:29.809822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:29.816248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:29.816727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:29.817169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:29.817860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:29.818341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:29.818794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:29.866790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:29.868961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:29.879823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:29.880180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:29.880622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:29.881320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:29.881774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:29.882204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:29.914553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-45c2756e-e4c4-426a-a4a6-7ec858f5a09e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 Nov 02 03:48:29.915114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 745/1491] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:30.169963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:30.178104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-058dbfab-6e27-4195-b678-1211bffcc564 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.372885 Nov 02 03:48:30.178669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 747/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:29 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:30.927085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:30.929309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:30.935637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:30.936160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:30.936603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:30.937297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:30.937774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:30.938199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:30.966986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3dd2d39a-9e80-4736-a78b-8459dc5b397c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Nov 02 03:48:30.967529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 746/1493] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:31.201524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:31.202078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:31.208973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:31.209455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:31.209893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:31.210592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:31.211047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:31.211474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:31.335493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:31.343683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-617578f6-0ec8-4352-8423-036c1f93e694 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146160 Nov 02 03:48:31.344827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 748/1494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:31.981660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:31.983989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:31.991327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:31.991702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:31.992177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:31.992880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:31.993337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:31.993762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:32.024349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0ae44ef6-98db-48c6-af58-05d1a49470b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048326 Nov 02 03:48:32.024925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 747/1495] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:32.367336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:32.367965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:32.374047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:32.374517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:32.375211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:32.375889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:32.376362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:32.376777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:32.506539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:32.514640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9e9ea36f-4993-4b93-9c34-b9f0a6e2ea5c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151117 Nov 02 03:48:32.515194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 749/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:33.037178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:33.039676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:33.047071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:33.047854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:33.048343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:33.049291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:33.049803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:33.050227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:33.080996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a7ad82cd-45df-4a47-b8a2-bebde0fd4f64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047875 Nov 02 03:48:33.081543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 748/1497] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:33.537670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:33.538702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:33.545330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:33.545810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:33.546248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:33.547497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:33.547960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:33.548399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:33.671571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:33.680229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9d8df014-dd73-4fa6-ba7a-152611b6cab9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146661 Nov 02 03:48:33.680806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 750/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:34.093186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:34.095921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:34.102636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:34.103376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:34.104014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:34.104714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:34.105163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:34.105585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:34.135277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-becd580e-c97d-4e0a-bf77-6bff8cf30434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Nov 02 03:48:34.135981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 749/1499] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:34.704002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:34.704598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:34.710959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:34.711430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:34.711860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:34.712562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:34.713011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:34.713426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:34.841933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:34.850035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad64b0c6-902b-4170-9946-f61fbd5a3a25 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150518 Nov 02 03:48:34.850586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 751/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:35.147750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:35.150094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:35.156678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:35.157167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:35.157617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:35.158314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:35.158773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:35.159198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:35.189954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb2c2a3f-122e-4ded-b476-3e4d2ba9e34c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Nov 02 03:48:35.190509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 750/1501] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:35.874051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:35.874595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:35.881250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:35.881731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:35.882195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:35.882881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:35.883333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:35.883756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:36.008802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:36.017570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c9216456-cca3-4e25-b5d0-eda20107eebd tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147468 Nov 02 03:48:36.018141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 752/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:35 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:36.202218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:36.205050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:36.211811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:36.212450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:36.212749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:36.213438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:36.213884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:36.214308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:36.243077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ed555c06-c193-4359-8d34-02941ce8813d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Nov 02 03:48:36.243873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 751/1503] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:37.040381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:37.041032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:37.047997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:37.048488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:37.049012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:37.049631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:37.050083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:37.050566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:37.175887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:37.184065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-26f9e4fa-a270-4432-8c11-fd06f6375a99 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147500 Nov 02 03:48:37.184628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 753/1504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:37.255410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:37.257704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:37.264207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:37.264796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:37.265140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:37.265832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:37.266388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:37.266695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:37.296254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-91069a14-a21b-48e1-9ad8-5392427653c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Nov 02 03:48:37.297448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 752/1505] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:38.208311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:38.208927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:38.215484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:38.216027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:38.216471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:38.217168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:38.217616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:38.218040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:38.313096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:38.318588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:38.326376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:38.326924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:38.327612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:38.328972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:38.329590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:38.330189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:38.334174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:38.363220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e6f0066b-c43a-49b3-8dfb-939e8ed37811 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054117 Nov 02 03:48:38.364076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 753/1506] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:38.376252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:38.384718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-001beae3-057b-4213-8afa-48898315eef5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.180150 Nov 02 03:48:38.385269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 754/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:39.375943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:39.378110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:39.384544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:39.385031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:39.385476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:39.386172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:39.386635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:39.387063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:39.410294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:39.410914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:39.417127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:39.417602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:39.418036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:39.418677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bc8285f6-2f17-47e3-9e4f-74480f6e688a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Nov 02 03:48:39.419012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:39.419555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 754/1508] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:39.423816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:39.424308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:39.551921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:39.560247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a38f3eb6-4095-4156-9ea0-87a3988f4d44 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.156516 Nov 02 03:48:39.560741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 755/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:48:40.431420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:40.433668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:40.440776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:40.441333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:40.441842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:40.442547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:40.443001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:40.443422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:40.473378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-62e60a84-513e-42fc-b57f-bad4ecd24ad6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Nov 02 03:48:40.473932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 755/1510] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:40.583107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:40.583721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:40.585721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:48:40.585881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:48:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 (ip 10.222.0.26) !!! Nov 02 03:48:40.592168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:40.592648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:40.593081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:40.594298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:40.594798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:40.595252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:40.726121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:40.734835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-197703d2-a7c6-4d29-87c7-8994bda312aa tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.155016 Nov 02 03:48:40.735399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 756/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:48:41.486352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:41.488703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:41.495081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:41.495640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:41.496195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:41.497019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:41.500327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:41.500807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:41.530361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f51e1927-a5b9-4991-af0b-1b2b3a34b0b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048532 Nov 02 03:48:41.531998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 756/1512] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:41.757920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:41.758733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:41.765200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:41.766183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:41.766618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:41.767309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:41.767792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:41.768233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:41.895678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:41.903858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-94777a3e-b7b3-48d8-b5c6-065c7ab6f21c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149783 Nov 02 03:48:41.904469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 757/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:42.542857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:42.545094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:42.551299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:42.551774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:42.552240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:42.552934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:42.553385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:42.553814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:42.585292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a66a649b-87bf-4f20-af43-4c020023fbc9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Nov 02 03:48:42.586134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 757/1514] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:42.928738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:42.929347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:42.935782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:42.936284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:42.936717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:42.937888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:42.938332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:42.938753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:43.065800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:43.073866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-61b4a034-f803-405c-8869-97c1d08d02d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149028 Nov 02 03:48:43.074437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 758/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:42 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:43.599803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:43.601977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:43.608338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:43.608809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:43.609810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:43.610486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:43.610935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:43.611352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:43.640281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2d638648-efea-44ec-95b8-ffd1694a4bbc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Nov 02 03:48:43.640836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 758/1516] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:44.097351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:44.097893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:44.100234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:44.105489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:44.105972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:44.106409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:44.107103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:44.107558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:44.108017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:44.235783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:44.243920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-27d05ee5-33cd-4f44-b0e5-872c332c7623 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151128 Nov 02 03:48:44.244500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 759/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:44.652737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:44.654880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:44.662164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:44.662645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:44.663081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:44.663771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:44.664251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:44.664679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:44.695649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9e22162a-2007-4e27-b660-c0440beb3f14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046806 Nov 02 03:48:44.696247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 759/1518] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:45.267914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:45.268549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:45.274881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:45.275361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:45.275817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:45.276526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:45.276977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:45.277396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:45.401312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:45.403490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:45.411313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-415b55a7-a44a-4f41-b5c5-11358d9d0506 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147747 Nov 02 03:48:45.411883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 760/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:45.709083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:45.711183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:45.717779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:45.718256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:45.718690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:45.719370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:45.719819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:45.720261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:45.748860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ac1ba804-b69f-4720-9787-d248f3a79164 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Nov 02 03:48:45.749409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 760/1520] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:46.434176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:46.434754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:46.441117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:46.441594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:46.442029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:46.442713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:46.443161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:46.443583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:46.573321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:46.582569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e501645-5ae0-45a4-aade-96c8a5c927be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152061 Nov 02 03:48:46.583564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 761/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:46.761939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:46.764061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:46.770988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:46.771461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:46.771896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:46.772595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:46.773044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:46.773464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:46.802309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-46d39cb6-4dd0-4674-b4bd-917ca2b7d152 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Nov 02 03:48:46.802847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 761/1522] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:47.606572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:47.607178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:47.614293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:47.614768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:47.615211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:47.615880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:47.616353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:47.616776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:47.743167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:47.752217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93fa641c-4b3b-4b10-b733-8f37d8e53615 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149507 Nov 02 03:48:47.752776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 762/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:47.815084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:47.817218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:47.819169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:48:47.819307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:48:47.830705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:47.831179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:47.831610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:47.832313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:47.832763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:47.833182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:47.861950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f3898bb3-b7e2-43f9-b092-051125f72031 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 Nov 02 03:48:47.862496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 762/1524] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:48.775086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:48.775699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:48.782023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:48.782498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:48.782933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:48.783644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:48.784124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:48.784547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:48.914919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:48.924028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8fd6c606-4ac2-4e1e-9d5d-a44bac2bce8c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152670 Nov 02 03:48:48.924799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 763/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:49.038917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:49.041303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:49.047259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:49.047727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:49.048192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:49.049423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:49.050070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:49.050490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:49.079851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-acb513e3-558e-4eca-ba90-d1ccbc2dc457 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209488 Nov 02 03:48:49.080469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 763/1526] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:49.947076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:49.947612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:49.954023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:49.954518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:49.955440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:49.956169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:49.956623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:49.957050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:50.083270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:50.091737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4115503a-196d-4ec7-b0cb-df92dbe4437d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148676 Nov 02 03:48:50.092082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:50.092541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 764/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:49 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:50.094377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:50.101560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:50.101991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:50.102424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:50.103128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:50.103580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:50.104035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:50.133665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-40562ed1-d1fe-46a8-abc8-efc2467ef648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Nov 02 03:48:50.134210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 764/1528] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:51.114991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:51.115546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:51.122112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:51.122589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:51.123025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:51.123726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:51.124184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:51.124608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:51.146615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:51.148817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:51.155765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:51.157701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:51.158237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:51.159060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:51.159387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:51.159812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:51.192584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-18dfaa09-8b5d-4358-b122-c9bfc402a540 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050510 Nov 02 03:48:51.193098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 765/1529] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:48:51.268461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:51.276685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cc9e8312-f012-483c-a848-4709484c58b5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.165493 Nov 02 03:48:51.277249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 765/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:52.205389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:52.207528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:52.209890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:52.215105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:52.215677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:52.216040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:52.216749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:52.217205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:52.217635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:52.248533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ee964be6-d59c-4311-98ae-2423c3b92f75 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047609 Nov 02 03:48:52.253323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 766/1531] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:52.299449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:52.300100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:52.306430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:52.306908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:52.307344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:52.308055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:52.308508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:52.308931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:52.439033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:52.447708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b221773f-83c1-4d13-8e30-25ef8ebab2a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152032 Nov 02 03:48:52.448302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 766/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:53.260918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:53.263040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:53.269379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:53.269852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:53.270280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:53.270962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:53.271420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:53.271839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:53.303230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-74f195d7-6cb1-4d47-8a91-13889049211a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Nov 02 03:48:53.303973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 767/1533] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:53.471558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:53.472196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:53.478554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:53.479034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:53.479469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:53.480209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:53.480661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:53.481083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:53.607211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:53.615314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c64a567b-0392-46a5-bf50-8dda1610ac36 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148037 Nov 02 03:48:53.615881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 767/1534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:54.315532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:54.317744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:54.327012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:48:54.327168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 03:48:54.333692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:54.334181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:54.334693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:54.335365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:54.335812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:54.336263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:54.369710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-722d4e32-8545-4057-9e6b-7e12e706c131 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058730 Nov 02 03:48:54.370265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 768/1535] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:54.638706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:54.639322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:54.645214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:54.645690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:54.646123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:54.646806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:54.647256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:54.647681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:54.776707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:54.785353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18d0004f-a467-4552-b7eb-21a2be48ef51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150688 Nov 02 03:48:54.785915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 768/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:55.382467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:55.384902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:55.391265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:55.391751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:55.393240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:55.393868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:55.394735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:55.395339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:55.422456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:48:55.428543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4715b50a-d10c-4dd4-822e-553f54a978e5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049936 Nov 02 03:48:55.429115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 769/1537] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:55.808970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:55.809586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:55.815999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:55.817115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:55.817883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:55.818929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:55.819493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:55.819917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:55.947922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:55.956126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a69a6564-7154-45e9-a907-a26168630f24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150932 Nov 02 03:48:55.956682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 769/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:56.440920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:56.443019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:56.449318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:56.449797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:56.450237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:56.450915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:56.451365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:56.451781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:56.483552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-46f349cd-5430-46b5-ba75-3da43adfd8f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Nov 02 03:48:56.484159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 770/1539] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:56.979674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:56.980315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:56.986734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:56.987211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:56.987647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:56.989053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:56.989511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:56.989936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:57.118302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:57.126795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f8b6da49-9bfc-46ce-9aa1-64872ce9538f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150976 Nov 02 03:48:57.127355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 770/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:56 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:57.496008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:57.498244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:57.504521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:57.505003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:57.505434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:57.506119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:57.506566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:57.507015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:57.541752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-816540b0-42a4-49e0-a7c3-f30f89977b22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049742 Nov 02 03:48:57.542316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 771/1541] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:58.150270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:58.150882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:58.157241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:58.157722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:58.158153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:58.158836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:58.159283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:58.159705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:58.287191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:58.295287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-817d4bcb-03c0-412f-89d4-1e4b14011d6f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149032 Nov 02 03:48:58.295846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 771/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:58.553968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:58.556123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:58.562483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:58.562967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:58.563400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:58.564124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:58.564575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:58.565037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:58.595464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af16d5a6-318c-4eed-ac1e-1d30b70d114c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Nov 02 03:48:58.596044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 772/1543] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:48:59.318655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:59.319192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:59.325931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:59.326410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:59.326841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:59.327586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:59.328061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:59.328485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:59.453445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:48:59.462125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0f22facd-cc6f-4ed4-b55b-c34b25d9c49c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147366 Nov 02 03:48:59.462687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 772/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:48:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:48:59.607561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:48:59.609712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:48:59.616117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:59.616596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:59.617037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:59.617725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:48:59.618179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:48:59.618604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:48:59.649554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-446154d1-0fab-4deb-b8e1-ac3bebd1522e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Nov 02 03:48:59.650108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 773/1545] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:48:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:00.484792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:00.485377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:00.492522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:00.492996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:00.493427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:00.494099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:00.494544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:00.494962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:00.627334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:00.635512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e533f8dc-0745-4b3d-ba40-e399d6d03125 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154589 Nov 02 03:49:00.636118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 773/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:00.661922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:00.664133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:00.670471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:00.670956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:00.671393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:00.672114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:00.672571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:00.672998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:00.702829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-799530b3-ec15-4faf-9b48-d2a831d876a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Nov 02 03:49:00.703390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 774/1547] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:01.658388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:01.659003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:01.665441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:01.665920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:01.666355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:01.667079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:01.667530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:01.667979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:01.714897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:01.717172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:01.723707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:01.724226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:01.724666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:01.725363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:01.725987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:01.726586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:01.759513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b1ffa008-87f7-4835-8e1d-5ac6c8055f6d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Nov 02 03:49:01.761205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 775/1548] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:01.802462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:01.810551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1ac97e19-0b55-4738-94cf-34dc56051977 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.155921 Nov 02 03:49:01.811110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 774/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:02.772394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:02.774526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:02.780514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:02.780998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:02.781433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:02.782124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:02.785906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:02.785906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:02.812708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-69c54df8-55f6-403e-8472-6b0bd3d0f972 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Nov 02 03:49:02.813254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 776/1550] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:02.834383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:02.834994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:02.841261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:02.841727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:02.842152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:02.842830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:02.843270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:02.843681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:02.976194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:02.984314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7b4ed09d-2df8-4038-810f-0579f0a78970 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154265 Nov 02 03:49:02.984870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 775/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:02 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:03.826257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:03.828424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:03.834515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:03.834972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:03.835472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:03.836262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:03.836709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:03.837125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:03.867499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f44bfd5a-1959-4e30-80cf-25eb12ea54e1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Nov 02 03:49:03.868074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 777/1552] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:04.006420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:04.007026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:04.013461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:04.013929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:04.014357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:04.015031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:04.015473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:04.015890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:04.140480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:04.149018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-86fbf04c-307e-41bc-80a3-40cd31647784 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146362 Nov 02 03:49:04.149576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 776/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:04.880885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:04.883057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:04.889552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:04.890033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:04.890470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:04.891193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:04.891648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:04.892099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:04.921711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2592caef-6801-4a54-9765-c28dd5b58d8c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Nov 02 03:49:04.922273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 778/1554] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:05.172382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:05.172921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:05.179781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:05.180281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:05.180711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:05.181473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:05.181939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:05.182364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:05.196866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:05.307169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:05.315263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a6add783-9cfe-4e1a-b0f7-96819e1635ca tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146699 Nov 02 03:49:05.315825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 777/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:05.934676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:05.936822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:05.943352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:05.943842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:05.944309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:05.945005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:05.945457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:05.945883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:05.975797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a246daec-bb64-4b40-b834-41687798686c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Nov 02 03:49:05.976580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 779/1556] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:06.338053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:06.338661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:06.340627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:49:06.340766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 (ip 10.222.0.26) !!! Nov 02 03:49:06.347159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:06.347638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:06.348094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:06.348772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:06.349215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:06.349654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:06.478703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:06.486881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-66d3086c-7883-40ba-9403-672bf5d751de tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152636 Nov 02 03:49:06.487439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 778/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:06.988266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:06.992328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:06.997468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:06.997956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:06.998400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:06.999214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:06.999671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:07.000957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:07.031493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-13f70905-6765-44e9-b3b2-ed77a53abec4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047178 Nov 02 03:49:07.032075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 780/1558] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:07.510722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:07.511332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:07.517700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:07.518168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:07.518599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:07.519279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:07.520377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:07.520797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:07.646629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:07.655008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-02cfbc94-9a54-4da9-9b99-bee7c1b061b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148132 Nov 02 03:49:07.655572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 779/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:08.044377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:08.046474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:08.053391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:08.053872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:08.054303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:08.054992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:08.055430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:08.055976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:08.085574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d3ab94b8-cfee-42b1-92dc-9210acea3c9a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Nov 02 03:49:08.086443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 781/1560] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:08.678056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:08.678669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:08.685089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:08.685564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:08.686001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:08.686685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:08.687132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:08.687554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:08.817769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:08.825875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58af59b5-447e-4102-bf60-ef82d71418bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151722 Nov 02 03:49:08.826440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 780/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:08 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:09.097048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:09.099686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:09.106169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:09.106649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:09.107093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:09.107769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:09.108249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:09.108671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:09.139631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c89194df-501d-460f-af31-2d1e8cee7ded tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Nov 02 03:49:09.140234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 782/1562] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:09.849697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:09.850234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:09.856901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:09.857367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:09.857795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:09.858500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:09.858945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:09.859361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:09.986293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:09.994348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9a6ddb6c-6640-423a-b321-a5393ecd9572 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149291 Nov 02 03:49:09.994892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 781/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:09 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:10.152011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:10.154236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:10.161773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:10.162266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:10.162710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:10.163413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:10.163868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:10.164341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:10.193848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edbd3611-abca-4aff-b069-a832204ef254 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Nov 02 03:49:10.194406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 783/1564] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:11.017186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:11.017801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:11.024441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:11.024925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:11.025362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:11.026055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:11.026505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:11.026931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:11.155182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:11.163404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-912baf82-bd30-4a4d-8860-297709fa8374 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150079 Nov 02 03:49:11.164179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 782/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:11.206382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:11.209114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:11.215657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:11.216105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:11.216488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:11.217189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:11.217644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:11.218123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:11.247684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6bdee4c7-9706-46e5-ba19-9aa77ace8378 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Nov 02 03:49:11.248287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 784/1566] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:12.188371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:12.188902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:12.195895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:12.196402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:12.197034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:12.197527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:12.197977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:12.198406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:12.260864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:12.263041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:12.269458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:12.269943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:12.270387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:12.271085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:12.271535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:12.272015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:12.310189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-42d696dd-bba5-4411-ab4c-50cd3ffdd707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053183 Nov 02 03:49:12.310743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 785/1567] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 03:49:12.333599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:12.341886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d59af06-9523-4489-8985-e1ba84cdca32 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.157415 Nov 02 03:49:12.342446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 783/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:13.322965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:13.325178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:13.331431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:13.332550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:13.333018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:13.333744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:13.334197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:13.334622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:13.348652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:13.364451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:13.365173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:13.365459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b833c93-4a5a-4958-98bf-df75f194af69 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Nov 02 03:49:13.366216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 786/1569] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:13.371538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:13.372040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:13.372476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:13.373174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:13.373622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:13.374050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:13.500288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:13.509091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6e317a8c-042f-4e55-92fd-8a0be6d1e050 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148444 Nov 02 03:49:13.509592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 784/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:14.377940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:14.380264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:14.386531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:14.387009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:14.387442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:14.388161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:14.388610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:14.389035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:14.418574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9530a2f0-8ecc-4cb8-a5a1-3bb4ec071d5e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Nov 02 03:49:14.419336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 787/1571] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:14.532655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:14.533269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:14.536196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:14.541505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:14.541980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:14.542413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:14.543103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:14.543546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:14.543985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:14.672717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:14.680769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d6139471-e416-4cb9-a4ab-a6d1a66e7a8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152018 Nov 02 03:49:14.681333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 785/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:15.431156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:15.433328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:15.439653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:15.440158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:15.440593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:15.441857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:15.442306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:15.442732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:15.472938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5663e214-0148-411b-8f71-590d1c8ba485 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Nov 02 03:49:15.473527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 788/1573] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:15.703649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:15.704206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:15.710475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:15.710965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:15.711380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:15.712088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:15.712534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:15.712951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:15.837035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:15.845149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-25db5e73-79a9-49ed-9837-533e7edd9578 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145374 Nov 02 03:49:15.845708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 786/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:15 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:16.485397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:16.487533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:16.494338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:16.494824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:16.495269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:16.495972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:16.496431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:16.496861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:16.528099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fe25f411-7631-45a0-a8a8-61c187a52eec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Nov 02 03:49:16.528989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 789/1575] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:16.868685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:16.869312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:16.875892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:16.876402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:16.876837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:16.877522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:16.877970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:16.878394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:17.005981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:17.014207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-84ad1c9c-dbca-4ae4-910f-dfaa0db5d9c4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149508 Nov 02 03:49:17.014762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 787/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:16 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:17.540968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:17.543289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:17.549495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:17.550043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:17.550545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:17.551296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:17.551914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:17.552401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:17.581288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb7e2b7d-e8bc-4d68-8571-d73ab33078f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Nov 02 03:49:17.582333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 790/1577] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:18.037509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:18.038119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:18.044506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:18.044980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:18.045417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:18.046099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:18.046551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:18.046975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:18.174376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:18.182995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-81e303b4-073f-4818-9f26-435c91d3d93f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149899 Nov 02 03:49:18.183556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 788/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:18.593971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:18.596128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:18.602576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:18.603056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:18.603489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:18.604213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:18.604669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:18.605097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:18.635522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f375668c-54fe-47a5-9428-aba99fc0f661 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Nov 02 03:49:18.636099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 791/1579] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:19.205661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:19.206272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:19.212660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:19.213126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:19.213556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:19.214232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:19.214676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:19.215088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:19.339118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:19.348029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5335c149-0519-4880-bf02-cd847722ef5a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145694 Nov 02 03:49:19.348598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 789/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:19.650512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:19.652696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:19.659031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:19.659509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:19.659979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:19.660666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:19.661122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:19.661546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:19.693505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cd566d30-3d31-4c9d-9983-23cdb2ea7112 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Nov 02 03:49:19.694230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 792/1581] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:20.371393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:20.372025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:20.378583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:20.379063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:20.379496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:20.380206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:20.380656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:20.381081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:20.510356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:20.520338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-488d73c1-df1a-40b6-8a2e-f7ad6f2ac32d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152713 Nov 02 03:49:20.520916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 790/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:20.706070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:20.708210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:20.714743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:20.715226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:20.715661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:20.716378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:20.716829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:20.717251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:20.749157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84290fbf-4cce-4008-8b91-02e3949f1ac3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Nov 02 03:49:20.750273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 793/1583] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:21.543173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:21.543779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:21.550663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:21.551136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:21.551566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:21.552282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:21.552724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:21.553149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:21.679027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:21.687147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-115604e2-5189-4c5e-889f-d7f0b93798b9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147839 Nov 02 03:49:21.687698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 791/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:21.762647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:21.764974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:21.771368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:21.771859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:21.772334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:21.773029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:21.773520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:21.773948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:21.804890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9ec62829-52f8-470f-b91a-39da8b6434c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046123 Nov 02 03:49:21.805599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 794/1585] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:22.710254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:22.710887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:22.717250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:22.717724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:22.718150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:22.718826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:22.719269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:22.719685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:22.826506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:22.829466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:22.837893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=58 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:22.843493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:22.844351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:22.845521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:22.846970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:22.847519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:22.848049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:22.855211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:22.865339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0988bafa-a7ba-4fdf-8978-ef20e5dd3969 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.158815 Nov 02 03:49:22.866060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 792/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:22 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:22.880801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68a41797-283f-42e7-9e0f-5530d93d54fa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068223 Nov 02 03:49:22.881911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 795/1587] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:23.897146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:23.897783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:23.898180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:23.899584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:23.904579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:23.905094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:23.905593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:23.905726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:23.906068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:23.906499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:23.906651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:23.907078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:23.907196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:23.907508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:23.907624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:23.908052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:23.939375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c300b59d-4691-4284-9e02-79624e53ed84 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Nov 02 03:49:23.944795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 793/1588] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:24.138859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:24.147693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9ad4d1ff-dcdf-4db4-a13d-fc7b04f23058 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.254913 Nov 02 03:49:24.148289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 796/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:23 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:24.952052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:24.954281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:24.961486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:24.961961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:24.962393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:24.963075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:24.963516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:24.963928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:24.966282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:24.994955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5b30d4a2-41cc-40fb-9e80-838504c9b968 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046745 Nov 02 03:49:24.995430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 794/1590] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:25.170790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:25.171367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:25.177772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:25.178250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:25.178686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:25.179369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:25.179819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:25.180264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:25.305238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:25.313510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-91347af0-eefe-448a-9843-ebd05a626558 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146702 Nov 02 03:49:25.314078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 797/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:26.007437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:26.009623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:26.015983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:26.016462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:26.016899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:26.017588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:26.018038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:26.018463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:26.047361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c4a690cf-6ab8-4e99-ac5e-681deb42538a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Nov 02 03:49:26.047912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 795/1592] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:26.336913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:26.337908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:26.344352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:26.344871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:26.345315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:26.346022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:26.346479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:26.347409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:26.475856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:26.484082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5f7f2dde-de37-49f0-8f6b-1df4d43531db tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150962 Nov 02 03:49:26.484646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 798/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:27.060985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:27.063329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:27.070374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:27.070829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:27.071276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:27.071935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:27.072401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:27.072821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:27.102526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f7edd8a3-d9a9-4773-8217-696ad6afce29 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Nov 02 03:49:27.103083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 796/1594] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:27.507644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:27.508285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:27.514138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:27.514619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:27.515051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:27.515729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:27.516201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:27.516622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:27.641285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:27.649390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b205d427-b944-4f28-8827-eb40f0215426 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146351 Nov 02 03:49:27.649956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 799/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:28.114669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:28.116877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:28.123185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:28.123664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:28.124121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:28.125077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:28.125524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:28.125950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:28.157180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c1572fe5-1f47-48ae-9413-4bee94860e64 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Nov 02 03:49:28.157903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 797/1596] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:28.673017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:28.673621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:28.680650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:28.681119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:28.681549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:28.682229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:28.682674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:28.683090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:28.814285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:28.822352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dac416d6-5658-409d-884e-5831aa915a3b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153139 Nov 02 03:49:28.822905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 800/1597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:29.170212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:29.172444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:29.178846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:29.179320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:29.179751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:29.180471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:29.180916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:29.181335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:29.211352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7a75e17d-7c35-4f87-b1f0-143d61132c48 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Nov 02 03:49:29.211907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 798/1598] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:29.845937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:29.846479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:29.853358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:29.853833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:29.854265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:29.854941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:29.855388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:29.855806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:29.980782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:29.989733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6626f5a0-38d0-4b51-9fc8-4fb800780202 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147674 Nov 02 03:49:29.990299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 801/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:29 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:30.223166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:30.225396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:30.231777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:30.232290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:30.232721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:30.233441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:30.233883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:30.234328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:30.263455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a852c1df-ec1e-45a1-ac01-8e8c8eb09612 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Nov 02 03:49:30.264216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 799/1600] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:31.012885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:31.013501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:31.020396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:31.020869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:31.021299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:31.021982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:31.022432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:31.022852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:31.148962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:31.157030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-452f455d-870b-48bc-8ad6-39e664841ac5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148041 Nov 02 03:49:31.157596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 802/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:31.275537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:31.281264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:31.285312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:31.285814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:31.286255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:31.287095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:31.287557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:31.288037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:31.318288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e242a1d8-c4e4-44f6-89ff-61f20a002e38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Nov 02 03:49:31.319131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 800/1602] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:32.181074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:32.181714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:32.188167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:32.188646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:32.189080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:32.189763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:32.190215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:32.190686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:32.193186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:32.317348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:32.325470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5fe9dbb2-a6bb-4e5f-9825-8b6dbbc9d432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148198 Nov 02 03:49:32.326241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 803/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:32.331473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:32.335122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:32.340642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:32.341605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:32.342047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:32.342773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:32.343231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:32.343660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:32.374725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-35e7666f-9c9d-4ec9-9320-f7a12d665a91 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047810 Nov 02 03:49:32.375547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 801/1604] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:33.349163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:33.349776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:33.356404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:33.356886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:33.357320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:33.358009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:33.358460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:33.358880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:33.386713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:33.388916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:33.396172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:33.396893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:33.397329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:33.398028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:33.398588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:33.398890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:33.430642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-94b6b68c-5e07-4d58-9e34-596bd14a53a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047767 Nov 02 03:49:33.431244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 802/1605] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:33.498725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:33.507319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cf38faf6-5819-4e9c-92f1-fb3c402d45b7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.162598 Nov 02 03:49:33.507846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 804/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:34.442557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:34.445323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:34.451533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.452048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.452484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.453165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.453610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.454029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.479222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:34.479749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:34.485883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-73448ab3-5710-4b29-9363-5a7db38f719d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 Nov 02 03:49:34.486375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.486855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.488051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.489120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.489574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.490848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.491387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 803/1607] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:34.516482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:49:34.532836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:34.533454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:34.542263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.542754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.543188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.543884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.544400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.556545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.600706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bc371340-176f-46ae-975f-a6f871dc795c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 204 len: 0 microversion: 2.1 time: 0.124764 Nov 02 03:49:34.601834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 805/1608] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:49:34 2022] DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 03:49:34.611537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:34.613406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:34.619628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.620217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.620993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.622227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:34.622345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:34.622712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:34.754322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:34.762654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f7445c4e-698b-49df-b3f5-e1199dcb47ab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.235392 Nov 02 03:49:34.763414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 804/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:34.780067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:34.789091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1c5e6b8b-b61c-4640-b726-77220f480b2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1727 microversion: 2.1 time: 0.183148 Nov 02 03:49:34.789657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 806/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:35.498866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:35.501303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:35.508211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.508682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.509113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.509797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.510240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.510780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.543154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-68790bc6-c3d1-4121-95df-a5a28d7627e2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Nov 02 03:49:35.543933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 805/1611] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:35.787603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:35.788169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:35.794486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.794962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.795392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.796113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.796561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.796979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.812302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:35.813060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:35.819734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.820379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.820944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.821874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:35.822430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:35.822946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:35.995787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:36.006868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:36.007550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ada86d73-6b89-4bbe-a136-fda400bb27a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.223764 Nov 02 03:49:36.008746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 807/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:35 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:36.020138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e74e8993-774f-425b-8fb7-4c583b31fe4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1727 microversion: 2.1 time: 0.211855 Nov 02 03:49:36.021028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 806/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:36.351657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9436aec2-8b2e-443f-a1c7-21a459f4bafa", "name": "network-vif-deleted", "tag": "1f57d818-7578-4909-88a4-e3f00ada7d97"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:49:36.365847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:36.366471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:36.367096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:36.383553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] Creating event network-vif-deleted:1f57d818-7578-4909-88a4-e3f00ada7d97 for instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa on hv-cinder-86020 Nov 02 03:49:36.388970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-c7dd35b1-c884-4783-9830-d59e341e1730 req-d076e233-879e-4685-ad1b-06f610efd0e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112231 Nov 02 03:49:36.389831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 808/1614] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:36.555291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:36.557579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:36.565851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:36.566342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:36.566783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:36.567483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:36.567939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:36.568387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:36.598318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e6c33c8b-a0c8-4e73-b28d-5e345d2a5285 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Nov 02 03:49:36.598885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 807/1615] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:37.034389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:37.035029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:37.041406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.041900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.042344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.043060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.043512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.043942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.044887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:37.045579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:37.052260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.052825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.053326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.054130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.054664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.055154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.143781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:37.151981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1949bb69-c20f-4e88-918e-9f410e74c33e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.111423 Nov 02 03:49:37.152782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 808/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:37.209743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:37.218430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-09445dcb-9940-46bb-89d5-5a1670a26803 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.188849 Nov 02 03:49:37.219014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 809/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:37.610720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:37.613516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:37.619898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.620407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.620894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.621531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:37.621981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:37.622404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:37.651756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-456c0cb1-ced8-4a70-87c3-47fc94eb2d6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Nov 02 03:49:37.652327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 809/1618] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 03:49:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:49:38.175506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:38.176154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:38.182699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.183218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.183660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:38.184394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.184881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.185311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:38.241824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:38.242490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:38.246327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:38.248453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.248930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.249359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:38.250317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.250757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.251189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:38.255192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-64b82794-b9e6-4da4-bd08-9d8cea24d9f9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083541 Nov 02 03:49:38.255965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 810/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:38.382395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:38.384638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:38.392254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-55aa5ca4-35e1-4a82-b49a-4e904a9c0eff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154069 Nov 02 03:49:38.393249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 810/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:38.664203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:49:38.666367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:38.672252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.672750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.673161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:38.673848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:38.674294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:38.675213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:39.017132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2ba1f43e-efe8-4dab-b034-2b860caf6e8e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action" status: 200 len: 74132 microversion: 2.1 time: 0.356503 Nov 02 03:49:39.018159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 811/1621] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 03:49:38 2022] POST /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04/action => generated 74132 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 03:49:39.278414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:39.279029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:39.286313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:39.286792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:39.287229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:39.287919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:39.288394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:39.288819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:39.351781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:39.360966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-64dd8aeb-5cc3-43d3-89c0-f6f73a508b87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086371 Nov 02 03:49:39.367005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 811/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:39.418312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:39.418992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:39.426088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:39.426574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:39.427010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:39.427700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:39.428192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:39.428621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:39.556299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:39.564896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-186f0dc0-ce24-4317-957c-90ee11e1aafe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150823 Nov 02 03:49:39.566070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 812/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:40.385485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:40.386100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:40.392570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:40.393046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:40.393483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:40.394170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:40.394620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:40.395040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:40.454689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:40.462804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51ad9087-e985-4b4d-90cf-b60af58f39c6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081252 Nov 02 03:49:40.463370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 812/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:40.589408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:40.590024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:40.596425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:40.596902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:40.597335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:40.598013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:40.598463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:40.598881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:40.726034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:40.734100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6d27b2ba-72ca-4113-882b-ae6a9bd1bf72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148567 Nov 02 03:49:40.734649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 813/1625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:41.485065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:41.485697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:41.492014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:41.492493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:41.492924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:41.493625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:41.494071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:41.494494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:41.554919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:41.563069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7cbd509d-9bfd-4276-bf0d-ec6d82016b6f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081830 Nov 02 03:49:41.563632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 813/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:41.757251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:41.757805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:41.764108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:41.764583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:41.765015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:41.765698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:41.766145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:41.766566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:41.899005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:41.907185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-12e69a74-b944-47bb-9d48-09b7f6b1b29f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153872 Nov 02 03:49:41.907750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 814/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:42.585640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:42.586190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:42.592520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:42.592995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:42.593430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:42.594111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:42.594560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:42.594983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:42.655152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:42.663730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae2f05b6-6c91-4e3d-bca4-0af105290eb7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081993 Nov 02 03:49:42.664324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 814/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:42.930721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:42.931285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:42.937579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:42.938058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:42.938494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:42.939175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:42.939628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:42.940079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:43.066458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:43.076287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-69227daa-f360-4efd-b402-7e6d1d5fe95a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149260 Nov 02 03:49:43.077043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 815/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:42 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:43.686865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:43.687473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:43.694423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:43.694894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:43.695321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:43.696017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:43.696464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:43.696883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:43.757208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:43.765221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6a1fb6ab-f25d-4299-bcc1-5eee2220ae53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082210 Nov 02 03:49:43.765775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 815/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:44.101338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:44.101956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:44.108482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:44.108969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:44.109411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:44.110110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:44.110565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:44.110994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:44.238374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:44.246488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c5c3c031-26e9-4f31-afda-772bce9f803b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149083 Nov 02 03:49:44.247047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 816/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:44.788189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:44.788713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:44.791016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=62 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:44.796319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:44.796795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:44.797230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:44.797916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:44.798367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:44.798784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:44.863302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:44.871931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d0761893-4a45-47b2-a808-b9029a6eba4f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087725 Nov 02 03:49:44.872518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 816/1632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:45.270110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:45.270726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:45.277095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:45.277573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:45.278009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:45.278692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:45.279143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:45.279581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:45.408134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:45.416884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3bd38f90-219b-4ac4-b248-3df9a7e7e6f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151140 Nov 02 03:49:45.417448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 817/1633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:45.896518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:45.897042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:45.903299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:45.903776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:45.904237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:45.904913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:45.905354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:45.905771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:45.965734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:45.973839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a411fd22-dcde-4571-8716-84ec8ae51715 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081886 Nov 02 03:49:45.974603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 817/1634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:46.439565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:46.440205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:46.446613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:46.447088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:46.447518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:46.448219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:46.448673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:46.449093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:46.574928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:46.583364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4fc9edad-72f3-42b3-92bd-455b81ad3948 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147608 Nov 02 03:49:46.583861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 818/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:46.996976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:46.997625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:47.004985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:47.005466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:47.005905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:47.006597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:47.007053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:47.007481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:47.067773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:47.075961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c1681ada-e0a8-40bc-8976-c951e165b858 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082907 Nov 02 03:49:47.076529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 818/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:47.606640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:47.607186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:47.614183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:47.614897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:47.615334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:47.616064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:47.616514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:47.616936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:47.619595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:47.746244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:47.754552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a7505581-1f57-44fd-a67f-f25c6a168b24 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151828 Nov 02 03:49:47.755107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 819/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:48.097848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:48.098484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:48.104894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:48.105366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:48.105793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:48.106471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:48.106918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:48.107331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:48.167409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:48.175923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-577c32ad-1069-483b-afe4-fc0b38de90dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081409 Nov 02 03:49:48.176500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 819/1638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:48.778422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:48.778987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:48.785975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:48.786461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:48.786902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:48.787596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:48.788077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:48.788508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:48.919097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:48.927818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-61bb118b-f3da-4975-9fb2-4e0685d88630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153386 Nov 02 03:49:48.928410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 820/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:49.199490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:49.200140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:49.207123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:49.207595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:49.208053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:49.208736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:49.209179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:49.209595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:49.269716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:49.277775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7960a6d2-95a6-4d03-99b5-e3519c43f46b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082139 Nov 02 03:49:49.278317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 820/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:49.950564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:49.951177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:49.957574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:49.958050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:49.958487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:49.959174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:49.959632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:49.960086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:50.084394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:50.092471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-43b22a7f-3b43-4f56-8aed-53c1337e3f8e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145779 Nov 02 03:49:50.093029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 821/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:49 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:50.301109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:50.301717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:50.308103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:50.308572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:50.309000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:50.309677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:50.310122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:50.310539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:50.369866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:50.378198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0109d0fb-1eea-4ee6-8ba2-c27edd37c538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081491 Nov 02 03:49:50.378766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 821/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:51.116054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:51.116686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:51.123093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:51.123570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:51.124025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:51.124715 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:51.125426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:51.125849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:51.255665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:51.263769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c6fe75eb-49c8-4df6-a733-9fddff667e62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151564 Nov 02 03:49:51.264358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 822/1643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:51.399696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:51.400353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:51.406621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:51.407093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:51.407524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:51.408239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:51.408713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:51.409207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:51.470768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:51.478781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8f163f2e-9fbd-4303-bd0b-9af60506b501 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082936 Nov 02 03:49:51.479342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 822/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:52.383010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:52.383635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:52.389526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:52.390006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:52.390440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:52.391129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:52.391581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:52.392033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:52.502016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:52.502777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:52.509218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:52.509698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:52.510160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:52.510855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:52.511305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:52.511728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:52.518848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:52.527542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9cf0f10a-95fe-4820-b9eb-7ab8e65012a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.244935 Nov 02 03:49:52.539711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 823/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:52.574840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:52.583212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-48aa5588-2b40-4787-9260-059ce195480e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085279 Nov 02 03:49:52.583778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 823/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:53.550879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:53.551492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:53.553788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:53.558934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:53.559412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:53.559849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:53.560570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:53.561030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:53.561453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:53.606089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:53.606704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:53.613574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:53.614051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:53.614485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:53.615175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:53.615623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:53.616072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:53.689474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:53.698150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-074adadf-7c36-4ed6-9eb6-578765151cf4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.095855 Nov 02 03:49:53.698722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 824/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:53.710927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:53.719083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-80f9a4d3-a195-43f6-927b-46db133e77d3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.172638 Nov 02 03:49:53.719638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 824/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:54.720931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:54.721528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:54.728184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:54.728670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:54.729110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:54.729805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:54.730258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:54.730712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:54.741581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:54.742188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:54.748586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:54.749066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:54.749503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:54.750446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:54.750895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:54.751314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:54.796661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:54.805616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-af23a5f8-c835-4317-bf0e-21d2b92f3829 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088484 Nov 02 03:49:54.806187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 825/1649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:54.891794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:54.900191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e2a9b432-026c-47bc-89d5-8aac11e67891 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.162984 Nov 02 03:49:54.900766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 825/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:49:55.828095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:55.828639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:55.835474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:55.835975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:55.836413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:55.837100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:55.837551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:55.838004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:55.898111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:55.906176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cac80a3e-f6fc-4639-a10d-10f0a6972a42 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082033 Nov 02 03:49:55.906828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 826/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:55.923575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:55.924250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:55.930527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:55.931006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:55.931444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:55.932168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:55.932622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:55.933046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:56.060661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:56.069241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a22b9d3-f59b-4bde-9a2f-459e35bff0e7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149504 Nov 02 03:49:56.069803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 826/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:56.929518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:56.930181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:56.936555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:56.937029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:56.937458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:56.938134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:56.938581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:56.939000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:56.953658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:56.999721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:57.008715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cbb6926c-372c-4471-9c6b-391d440f1c28 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083063 Nov 02 03:49:57.009276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 827/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:57.092737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:57.093355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:57.099657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:57.100192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:57.100636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:57.101332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:57.101785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:57.102211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:57.227470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:57.235530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edfb2225-0ccc-4eb6-a297-b4057aeb9eab tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146708 Nov 02 03:49:57.236102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 827/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:58.031813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:58.032459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:58.038774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:58.039248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:58.039680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:58.040389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:58.040840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:58.041257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:58.103388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:58.111478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-10ecefad-f667-41e3-aebb-c72d73f723b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083521 Nov 02 03:49:58.112056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 828/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:58.259359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:58.259985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:58.266337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:58.266819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:58.267269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:58.267967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:58.268420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:58.268842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:58.395668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:58.403742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-97ba5567-485d-42de-b8d3-03f38c461a0e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148223 Nov 02 03:49:58.404333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 828/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:59.135033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:59.135687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:59.142050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:59.142531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:59.142972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:59.144344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:59.144814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:59.145242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:59.207855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:59.216045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-24a7aea9-6716-4dd1-8f91-bc37191844db tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084877 Nov 02 03:49:59.216608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 829/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:49:59.427164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:49:59.427720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:49:59.434196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:59.434677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:59.435111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:59.435797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:49:59.436282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:49:59.436707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:49:59.564130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:49:59.572945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-03ab93ab-6a10-4c5b-9f1e-1ef58a97fab6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150265 Nov 02 03:49:59.573508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 829/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:49:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:00.238216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:00.238832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:00.245192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:00.245672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:00.246108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:00.246792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:00.247247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:00.247669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:00.307138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:00.315588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8513704d-0408-4564-803e-d17853324234 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081193 Nov 02 03:50:00.316199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 830/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:00.595814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:00.596462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:00.602829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:00.603312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:00.603752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:00.604469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:00.604926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:00.605353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:00.728661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:00.736770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e4cd266c-fad8-4ef0-aebf-2ee980d2d27c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144804 Nov 02 03:50:00.737333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 830/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:01.338130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:01.338741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:01.345133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:01.345606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:01.346039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:01.347227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:01.347676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:01.348142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:01.413603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:01.422019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b814a98-75fd-4695-9314-7dd0bd4d5242 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087767 Nov 02 03:50:01.422586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 831/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:01.760506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:01.761149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:01.767563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:01.768070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:01.769037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:01.769727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:01.770180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:01.770604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:01.895286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:01.903386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6a180128-d0dc-49b9-b5c6-3a84230681cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146759 Nov 02 03:50:01.903973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 831/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:02.445815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:02.446438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:02.452952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:02.453433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:02.453877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:02.454562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:02.455016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:02.455439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:02.515719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:02.523888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e20647ae-7682-48eb-a15e-4baa09bb7ed5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081949 Nov 02 03:50:02.524476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 832/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:02.927351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:02.927982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:02.934343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:02.934826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:02.935265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:02.935980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:02.936436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:02.936872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:03.063127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:03.071373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1c3468d8-a52a-4e9b-b840-dba4b99e5ade tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148657 Nov 02 03:50:03.071935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 832/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:02 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:03.546313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:03.546921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:03.553403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:03.553876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:03.554306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:03.555001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:03.555433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:03.555855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:03.615306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:03.623382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc9129b8-9842-4b47-88ef-81841f223d0b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080940 Nov 02 03:50:03.623940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 833/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:04.094200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:04.094818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:04.101187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:04.101667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:04.102104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:04.102795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:04.103250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:04.103674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:04.227113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:04.235191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9c1c6e35-9265-4d00-93c0-6e0eede983ac tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144881 Nov 02 03:50:04.235745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 833/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:04.646697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:04.647324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:04.653807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:04.654286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:04.654732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:04.655423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:04.655881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:04.656334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:04.718948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:04.727770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3c44c2c6-2b4a-44b6-a7d0-08b2a0ff7c7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085507 Nov 02 03:50:04.728367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 834/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:05.259151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:05.259742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:05.266170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:05.266648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:05.267078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:05.267759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:05.268236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:05.268652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:05.598053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:05.606088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-89d6c536-61c5-401c-83b0-c63a521bb198 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.350760 Nov 02 03:50:05.606647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 834/1668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:05.750528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:05.751139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:05.758093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:05.758562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:05.758991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:05.759668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:05.760159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:05.760579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:05.819536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:05.827529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9f98cc7e-a030-48ac-b555-7ea4d2a328eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081035 Nov 02 03:50:05.828117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 835/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:06.630113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:06.630760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:06.637215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:06.637700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:06.638138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:06.638830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:06.639288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:06.639716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:06.764819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:06.767024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:06.774953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-00c04087-a07e-4917-b20f-a8001124c630 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149224 Nov 02 03:50:06.775580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 835/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:06.849698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:06.850246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:06.856664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:06.857145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:06.857585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:06.858278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:06.858734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:06.859159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:06.927109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:06.935317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2fb59f2e-c11e-4bc8-845b-0a163d0b899b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089476 Nov 02 03:50:06.935912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 836/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:07.797968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:07.798532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:07.804896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:07.805398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:07.805829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:07.806503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:07.806950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:07.807368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:07.930510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:07.938581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ac7d5192-68af-49af-9cb8-a9f78d1fa2f3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144549 Nov 02 03:50:07.939144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 836/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:07.958914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:07.959518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:07.965971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:07.966559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:07.966999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:07.967688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:07.968179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:07.968602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:08.032919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:08.041914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-37a23283-8b47-4f98-8bfd-b7614eec20c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087228 Nov 02 03:50:08.042492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 837/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:08.961340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:08.961948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:08.968334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:08.968810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:08.969242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:08.969919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:08.970363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:08.970780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:09.064336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:09.064980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:09.071931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:09.072433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:09.072861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:09.073545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:09.073986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:09.074403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:09.097331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:09.105488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ccf1fe87-46a8-4fdc-8649-9e66456d4d7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147961 Nov 02 03:50:09.106045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 837/1674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:08 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:09.134489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:09.142579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e2ff8f3e-52e9-4bb9-b555-871ab038fb70 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082014 Nov 02 03:50:09.143164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 838/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:10.128225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:10.128872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:10.135327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:10.135798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:10.136263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:10.136941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:10.137389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:10.137806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:10.166211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:10.166821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:10.173205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:10.173688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:10.174121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:10.174812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:10.175262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:10.175684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:10.245747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:10.254063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d0327a4e-98be-4004-9451-26fb6ce3ca7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.092356 Nov 02 03:50:10.254629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 839/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:10.286519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:10.294836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2cd2005e-919d-41a6-8523-8f720690d6a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.170681 Nov 02 03:50:10.295400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 838/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:10 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:11.277104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:11.277716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:11.284198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:11.284675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:11.285109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:11.285796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:11.286244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:11.286703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:11.317481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:11.318624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:11.325024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:11.325502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:11.325932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:11.326623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:11.327065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:11.327481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:11.347252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:11.355401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-36a94500-0802-458c-a1b6-c3a328b47198 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082106 Nov 02 03:50:11.355982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 840/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:11.458523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:11.466469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a0cde7da-c531-47eb-a973-acee71e60247 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152839 Nov 02 03:50:11.467030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 839/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:12.378821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:12.379351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:12.386231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:12.386697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:12.387125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:12.387834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:12.388300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:12.388718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:12.447927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:12.455905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cc2759aa-6b11-4592-8612-5ca42e924dfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081226 Nov 02 03:50:12.456485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 841/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:12.490043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:12.491284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:12.497573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:12.498047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:12.498478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:12.499157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:12.499603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:12.500309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:12.626488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:12.634619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e8d3cd93-dc24-44af-80d0-a756031cd4ff tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148634 Nov 02 03:50:12.635128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 840/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:13.478465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:13.479065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:13.485405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:13.485877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:13.486303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:13.486991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:13.487432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:13.487845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:13.550500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:13.558674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4fd0c2b8-cee5-484f-8fd6-6b426e74151b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084035 Nov 02 03:50:13.559224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 842/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:13.657805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:13.658414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:13.664826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:13.665327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:13.665758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:13.666438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:13.666883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:13.667300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:13.793692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:13.801802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-461f5c3f-309e-434d-b295-95f9409c092f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148008 Nov 02 03:50:13.802358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 841/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:14.581773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:14.582414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:14.589315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:14.589808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:14.590223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:14.590907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:14.591358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:14.591779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:14.651570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:14.659712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9f5edd8b-a7f7-4936-b74c-18f595516f71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081886 Nov 02 03:50:14.660303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 843/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:14.825390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:14.825938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:14.832337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:14.832823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:14.833259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:14.834512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:14.834969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:14.835393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:14.966702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:14.974984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aab0da53-2268-4e00-a8be-2700b934a384 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153540 Nov 02 03:50:14.975544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 842/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:15.683128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:15.683746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:15.686085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=56 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:15.691364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:15.691848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:15.692317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:15.693006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:15.693463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:15.693890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:15.697965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:15.755470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:15.763568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2dc4a41d-a358-4bd6-bcdf-f88f2322ee25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084304 Nov 02 03:50:15.764155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 844/1686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:15.997745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:15.998358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:16.004875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:16.005368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:16.005792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:16.006479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:16.006931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:16.007358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:16.131631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:16.139704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a126efdb-9e9e-4dbb-b603-0955ffa427a4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145750 Nov 02 03:50:16.140243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 843/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:15 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:16.785551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:16.786102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:16.792632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:16.793112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:16.793553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:16.794244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:16.794697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:16.795124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:16.855033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:16.863143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7a298438-75fe-4253-856f-3bdfabe60267 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081547 Nov 02 03:50:16.863704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 845/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:17.162511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:17.163115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:17.169471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:17.169945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:17.170372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:17.171052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:17.171497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:17.171914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:17.298716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:17.307516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84ee9a75-61a7-4e04-aa31-ebb69bed0814 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149233 Nov 02 03:50:17.308033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 844/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:17 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:17.886801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:17.887408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:17.893688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:17.894154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:17.894583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:17.895257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:17.895699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:17.896144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:17.955474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:17.964161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cddbb0af-a8ea-46da-916f-7395d05d1cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081175 Nov 02 03:50:17.964716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 846/1690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:18.330319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:18.330970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:18.337406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:18.337885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:18.338317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:18.339000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:18.339449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:18.339873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:18.466134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:18.474182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7348b9fa-86e8-44de-9113-ffacb2f28056 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147721 Nov 02 03:50:18.475252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 845/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:18.986279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:18.986890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:18.993489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:18.993965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:18.994400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:18.995084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:18.995528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:18.996019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:19.056878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:19.065009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d1bbf540-d11b-4686-bb9b-b96564f45afd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082591 Nov 02 03:50:19.065591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 847/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:19.497072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:19.497710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:19.504368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:19.504846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:19.505280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:19.506463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:19.506910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:19.507330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:19.635268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:19.643367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71c9cc9a-5ac7-45ed-af48-16ef31056d56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150130 Nov 02 03:50:19.643978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 846/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:20.087506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:20.088151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:20.094602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:20.095082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:20.095514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:20.096232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:20.096683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:20.097104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:20.158411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:20.166971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d9dd72cf-cba4-4bad-893a-9b82f031029f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083327 Nov 02 03:50:20.167532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 848/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:20.666692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:20.667313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:20.673846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:20.674332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:20.674770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:20.675461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:20.675917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:20.676374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:20.806116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:20.814200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-07bfe93f-3813-4133-a55d-608f54b0a0dc tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151979 Nov 02 03:50:20.814763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 847/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:21.190288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:21.190850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:21.198118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:21.198590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:21.199020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:21.199708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:21.200180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:21.200605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:21.262299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:21.270449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58aa4f72-d4ce-47ff-b239-fe6eec7fbda0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084128 Nov 02 03:50:21.271009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 849/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:21.836939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:21.837505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:21.843876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:21.844384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:21.844817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:21.845501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:21.845955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:21.846406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:21.972890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:21.980965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-beefa314-81f9-47ab-96df-b9c39f39138a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148580 Nov 02 03:50:21.981529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 848/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:22.293487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:22.294109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:22.300297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:22.300772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:22.301209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:22.301891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:22.302337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:22.302756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:22.363229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:22.371241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9181de67-1d6e-4598-a3ff-86befac5f473 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081586 Nov 02 03:50:22.371797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 850/1698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:23.004227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:23.004843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:23.011790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:23.012351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:23.012789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:23.013477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:23.013928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:23.014345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:23.139370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:23.149048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6184d041-08ec-4b85-a81f-d10df625928a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148805 Nov 02 03:50:23.149621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 849/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:22 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:23.394551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:23.395078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:23.401509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:23.401999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:23.402420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:23.403106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:23.403558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:23.404040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:23.463867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:23.471914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b27d163d-7996-4dc2-bbe3-164bc5205da4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081286 Nov 02 03:50:23.472496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 851/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:24.171729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:24.172365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:24.174634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:24.179788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:24.180295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:24.180727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:24.181420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:24.181868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:24.182285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:24.312033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:24.320079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67e762aa-f031-4c8a-8307-249e594d4785 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152181 Nov 02 03:50:24.320642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 850/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:24 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:24.494645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:24.495260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:24.501530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:24.501893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:24.502328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:24.503013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:24.503463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:24.503913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:24.564642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:24.573251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2306f962-747c-4d00-808e-63e195375b80 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082710 Nov 02 03:50:24.573808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 852/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:25.343276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:25.343892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:25.350922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:25.351403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:25.351883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:25.352605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:25.353056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:25.353479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:25.480947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:25.489048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4bb3540f-1657-4ce1-adb0-63a604264415 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149661 Nov 02 03:50:25.489624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 851/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:25.595652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:25.596344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:25.603174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:25.603650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:25.604113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:25.604791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:25.605265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:25.605683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:25.666670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:25.674615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3dca2750-1799-4854-9384-0326a4795b9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082823 Nov 02 03:50:25.675169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 853/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:26.512739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:26.513379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:26.519696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:26.520202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:26.520652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:26.521313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:26.521760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:26.522175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:26.536725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:26.650256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:26.658212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bb141d89-1ed7-48c8-a238-930cce82c81e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149401 Nov 02 03:50:26.658765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 852/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:26.697637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:26.698248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:26.704653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:26.705123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:26.705554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:26.706231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:26.706675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:26.707114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:26.767198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:26.775262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-00682bf5-fd80-467a-89d7-c21f5d33f147 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082095 Nov 02 03:50:26.775813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 854/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:27.681140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:27.681769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:27.687710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:27.688223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:27.688664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:27.689358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:27.689812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:27.690240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:27.797834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:27.798399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:27.805094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:27.805574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:27.806009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:27.806707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:27.807151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:27.807568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:27.874266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:27.883212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8b0d9b09-8cb2-4ffc-8bad-40b306460165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089358 Nov 02 03:50:27.883783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 855/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:27.967982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:27.976087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63df5ece-ceb4-4e24-931a-99add0ad671f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.299241 Nov 02 03:50:27.976642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 853/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:28.905979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:28.906520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:28.913528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:28.914001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:28.914433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:28.915118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:28.915580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:28.916015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:28.978993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:28.988630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a8536680-b2e5-4437-945b-815204e9f87a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086614 Nov 02 03:50:28.989187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 856/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:28.998466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:28.999080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:29.006248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:29.006725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:29.007161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:29.007846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:29.008325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:29.008747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:29.136913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:29.144958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b7efee69-e9be-484e-ac2d-f58eee00b5a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150334 Nov 02 03:50:29.145519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 854/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:30.011065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:30.011678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:30.018146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:30.018615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:30.019043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:30.019720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:30.020198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:30.020619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:30.080519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:30.089126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87c45bd3-f2bd-4ddf-bedf-ce6e8e5ce7b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081900 Nov 02 03:50:30.089683 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 857/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:30.168278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:30.168892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:30.175450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:30.175928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:30.176395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:30.177085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:30.178034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:30.178456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:30.302180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:30.311068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dfdb429c-b768-40e6-aa8d-1b96576fd546 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146599 Nov 02 03:50:30.311610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 855/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:30 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:31.111537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:31.112198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:31.119073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:31.119554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:31.120005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:31.120698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:31.121147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:31.121569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:31.122124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:50:31.122249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:50:31.187171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:31.195890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0997760d-8331-47ab-9893-211896d509d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088244 Nov 02 03:50:31.196544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 858/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:31.334587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:31.335191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:31.341632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:31.342102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:31.342557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:31.343238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:31.343684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:31.344134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:31.471235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:31.479838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eebabbc6-256e-48a0-a1cb-0ff2e7552cc6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149086 Nov 02 03:50:31.480416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 856/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:32.217361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:32.217970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:32.224433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:32.224909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:32.225339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:32.226021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:32.226467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:32.226891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:32.287141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:32.296177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-41451654-644c-4e37-ad47-da121645915a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082594 Nov 02 03:50:32.296742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 859/1715] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:32.503237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:32.503875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:32.510891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:32.511371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:32.511808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:32.512547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:32.512999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:32.513425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:32.642896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:32.650927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9a2c312e-d849-4f73-8cd2-c1c4e9691740 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151821 Nov 02 03:50:32.651460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 857/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:33.321014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:33.321677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:33.328148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:33.328619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:33.329046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:33.329723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:33.330163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:33.330581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:33.391213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:33.393363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:33.400964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-628be648-049c-4abc-a12f-c01fa72e9c76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083830 Nov 02 03:50:33.401525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 860/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:33.674395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:33.674948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:33.681313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:33.681792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:33.682230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:33.682918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:33.683373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:33.683801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:33.807064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:33.815245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7f020591-359b-43ba-91cf-2afdf487a708 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144775 Nov 02 03:50:33.815806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 858/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:34.424107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:34.424719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:34.431868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:34.432372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:34.432807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:34.433493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:34.433940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:34.434364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:34.497083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:34.505486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7c89c3b5-3784-441d-8ebe-9056fc472d74 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085345 Nov 02 03:50:34.506045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 861/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:34.838908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:34.839547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:34.846177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:34.846649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:34.847078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:34.847758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:34.848241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:34.848661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:34.976952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:34.985086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ab40e159-0fa8-4a56-88ad-d2a7881a9b62 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150546 Nov 02 03:50:34.985637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 859/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:35.527916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:35.528557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:35.535190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:35.535676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:35.536174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:35.536876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:35.537331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:35.537759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:35.600219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:35.608273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d938d209-9538-444d-a483-444c8b44d0fa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084172 Nov 02 03:50:35.608832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 862/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:36.008249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:36.008874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:36.015260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:36.015742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:36.016231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:36.016927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:36.017386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:36.017815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:36.145318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:36.154176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-efc43588-8654-4433-8f2b-8bd2a95615e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149818 Nov 02 03:50:36.154737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 860/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:36 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:36.631913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:36.632552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:36.639173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:36.639659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:36.640150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:36.640879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:36.641331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:36.641760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:36.701780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:36.710600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8ea3bd7f-d0db-473e-b285-9091f5761266 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083043 Nov 02 03:50:36.711170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 863/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:37.177765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:37.178905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:37.185259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:37.185736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:37.186166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:37.186855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:37.187306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:37.187726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:37.312131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:37.320162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-19ba96a1-9c62-454e-ac06-a2f0ec2aa973 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146395 Nov 02 03:50:37.320725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 861/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:37.733326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:37.733935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:37.740351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:37.740828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:37.741261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:37.741946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:37.742395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:37.742817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:37.806206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:37.814374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c809637-3a81-4c37-8c45-4e1437151fd3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084940 Nov 02 03:50:37.814931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 864/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:38.342954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:38.343562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:38.349931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:38.350408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:38.350842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:38.351526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:38.351999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:38.352424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:38.479418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:38.487776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f75334bb-d9cb-4c87-a273-2b1a54159214 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148717 Nov 02 03:50:38.488368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 862/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:38.837146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:38.837705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:38.844094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:38.844576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:38.845012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:38.845697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:38.846152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:38.846576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:38.910386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:38.919205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7b538388-ae2d-4d50-b91b-eee0956eeb78 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085989 Nov 02 03:50:38.919782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 865/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:39.511151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:39.511760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:39.518268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:39.518742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:39.519174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:39.519860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:39.520335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:39.520757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:39.650558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:39.658722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a7d6c159-143e-41d8-97a3-932c52bc6815 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151515 Nov 02 03:50:39.659280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 863/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:39.942593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:39.943138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:39.950200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:39.950674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:39.951107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:39.951792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:39.952275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:39.952704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:40.012970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:40.021162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-45251162-eb13-405b-b743-baed272f3c98 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082477 Nov 02 03:50:40.021729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 866/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:40.681448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:40.682099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:40.688464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:40.688943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:40.689379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:40.690072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:40.690544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:40.690952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:40.815719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:40.823740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d489b825-e2c2-445f-8795-e171ecaa7087 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146208 Nov 02 03:50:40.824322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 864/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:41.043758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:41.044395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:41.050769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:41.051252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:41.051686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:41.052397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:41.052847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:41.053284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:41.116005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:41.124197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e0d09e4c-402a-4e4b-81ad-d6317192b579 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084237 Nov 02 03:50:41.124754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 867/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:41.846945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:41.847553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:41.854604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:41.855077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:41.855506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:41.856216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:41.856668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:41.857089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:41.983869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:41.992595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-184f22d6-3130-44a9-900f-e35101b8b15a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149515 Nov 02 03:50:41.993487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 865/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:42.146491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:42.147606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:42.154005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:42.154482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:42.154919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:42.155606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:42.156080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:42.156507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:42.216323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:42.224430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e5e19c3f-a0cd-4a83-87b0-5ad22cfd0ac5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081763 Nov 02 03:50:42.225633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 868/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:43.017520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:43.018158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:43.024690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:43.025166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:43.025598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:43.026290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:43.026765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:43.027189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:43.157842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:43.167166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-27d65505-192b-4eef-a4ba-47ae0c315502 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154137 Nov 02 03:50:43.167738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 866/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:43 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:43.247830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:43.248477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:43.254978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:43.255456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:43.255887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:43.256651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:43.257101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:43.257523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:43.319146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:43.327404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9973745a-3155-4114-a81a-6e22b280e728 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083444 Nov 02 03:50:43.327969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 869/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:44.191833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:44.192473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:44.199312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:44.199785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:44.200249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:44.200930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:44.201379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:44.201805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:44.326757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:44.334854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bc7581cd-ee49-40d4-ae45-3a09e3cbaa12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146977 Nov 02 03:50:44.335408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 867/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:44.349958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:44.350572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:44.357113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:44.357588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:44.358016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:44.358694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:44.359134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:44.359549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:44.423785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:44.431850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-157fd788-8fa3-4a76-9ec5-439edf4899ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085704 Nov 02 03:50:44.432441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 870/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:45.357586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:45.358219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:45.364652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:45.365137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:45.366076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:45.366766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:45.367219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:45.367644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:45.453841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:45.454544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:45.460951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:45.461515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:45.462016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:45.462780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:45.463301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:45.463976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:45.494383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:45.502894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-43956159-aaa4-4c2b-9384-b5a0c97550fe tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149246 Nov 02 03:50:45.503463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 868/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:45.524159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:45.532404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-48e627e6-ba8c-4efc-a8ad-604c13ab5a5d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082284 Nov 02 03:50:45.532986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 871/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:46.526596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:46.527209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:46.533667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:46.534172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:46.534606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:46.535324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:46.535772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:46.536217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:46.538762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:46.556324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:46.557023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:46.563558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=56 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:46.565390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:46.565822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:46.566265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:46.566985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:46.567441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:46.567873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:46.650050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:46.658245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b60babf8-5f20-4717-8ccb-6657b951cde8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.107493 Nov 02 03:50:46.659032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 872/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:46.685857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:46.694578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1d2cef82-13d7-42f9-ac32-96cc306b0349 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.172641 Nov 02 03:50:46.695128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 869/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:47.681504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:47.682125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:47.688532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:47.689017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:47.689456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:47.690142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:47.690593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:47.691020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:47.717591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:47.718202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:47.724851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:47.725331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:47.725763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:47.726454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:47.726901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:47.727322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:47.751734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:47.760757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1914513d-22a7-4942-93d2-fb8748690f18 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083133 Nov 02 03:50:47.761328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 873/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:47.853969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:47.862031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9ff9ea66-04b7-4ef7-a4c2-718354cf3c1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148287 Nov 02 03:50:47.862593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 870/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:48.784175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:48.784730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:48.791117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:48.791591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:48.792054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:48.792741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:48.793194 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:48.793613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:48.857391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:48.865876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-572cf396-9eba-44a9-a1c2-8bbd65318306 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085104 Nov 02 03:50:48.866433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 874/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:48.886401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:48.887117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:48.893400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:48.893872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:48.894302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:48.894981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:48.895431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:48.895850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:49.021376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:49.029494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e97f00be-2d41-45fd-8666-2d3e952c7e7f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146903 Nov 02 03:50:49.030044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 871/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:49.889168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:49.889700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:49.896087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:49.897072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:49.897507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:49.898193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:49.898646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:49.899069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:49.964974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:49.973139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0f65a61b-61b2-4fd9-bd51-cbe941ddbdb4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087933 Nov 02 03:50:49.973707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 875/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:50.055031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:50.055640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:50.061978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:50.062483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:50.062919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:50.063598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:50.064071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:50.064494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:50.188003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:50.196744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-51033b31-747a-4490-9bb0-e5f1e7f6b314 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145542 Nov 02 03:50:50.197300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 872/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:50 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:50.996557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:50.997168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:51.003723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:51.004291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:51.004723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:51.005405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:51.005852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:51.006277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:51.215883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:51.220765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:51.221462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:51.224085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ebf1577f-2208-4a6f-bb53-c01a2e1d9341 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.231298 Nov 02 03:50:51.225225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 876/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:51.230583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:51.231067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:51.231501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:51.232231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:51.232679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:51.233102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:51.361002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:51.369254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4220a3ae-ca57-4cf8-85f5-315cfc52658d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153090 Nov 02 03:50:51.370009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 873/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:50:52.247490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:52.248167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:52.254747 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:52.255221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:52.255657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:52.256862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:52.257312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:52.257737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:52.272479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:52.317781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:52.326418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad4e4cbb-53ee-44cf-8484-f5b5c52b0980 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082822 Nov 02 03:50:52.326967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 877/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:52.392960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:52.393574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:52.400707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:52.401190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:52.401627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:52.402317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:52.402771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:52.403196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:52.526159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:52.534441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1861ce07-8d34-42bf-9cf3-64095d9eec7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145259 Nov 02 03:50:52.535007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 874/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:53.349193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:53.349809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:53.356311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:53.356793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:53.357229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:53.357920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:53.358375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:53.358802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:53.422227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:53.430823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51349def-5da9-4bda-9b23-f01b0c87b73e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085514 Nov 02 03:50:53.431385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 878/1752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:53.557877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:53.558500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:53.564949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:53.565433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:53.565872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:53.566568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:53.567030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:53.567458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:53.691846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:53.700587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b9de65b-da20-4de6-a949-8324d39e6811 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146663 Nov 02 03:50:53.701149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 875/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:54.454319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:54.454865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:54.461348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:54.461820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:54.462252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:54.462934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:54.463378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:54.463797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:54.523802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:54.531962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e04d8a0-3f44-47dd-ada1-f3337e731ead tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081710 Nov 02 03:50:54.532532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 879/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:54.724712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:54.725337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:54.727624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=52 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:50:54.732969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:54.733459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:54.733903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:54.734606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:54.735065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:54.735500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:54.861806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:54.870536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-55cd0c95-28ce-4e5f-bf8f-0ba2252fc245 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149704 Nov 02 03:50:54.871153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 876/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:55.555163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:55.555917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:55.562171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.562652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.563087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.563782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.564261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.564685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.619458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:55.620001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:55.626600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:55.626964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.627557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.628138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.629119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.630110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.630632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.634870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7bf72229-035c-4b0f-91a5-cf6b1dee9608 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084184 Nov 02 03:50:55.637018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 880/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:55.662933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:50:55.748059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b7046aec-d7d5-43ad-9dad-7427489d7dc8 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 204 len: 0 microversion: 2.20 time: 0.132183 Nov 02 03:50:55.749253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 877/1757] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 03:50:55 2022] DELETE /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 03:50:55.757854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:55.758703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:55.766488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.766970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.767408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.768135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.768583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.769010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.893452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:55.894691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:55.895388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:55.901735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.902048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:55.902210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.902643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.903331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:55.903487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:55.903796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:55.904274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:55.904750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f56f8e6-bcd9-432c-8108-b08dc75bfa95 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1725 microversion: 2.20 time: 0.151090 Nov 02 03:50:55.905298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 881/1758] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:50:55 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:50:56.032365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:56.040482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bd473684-47a6-43fc-92dd-99828c9c72da tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150138 Nov 02 03:50:56.041037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 878/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:56.657935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:56.659204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:56.666404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:56.666896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:56.667332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:56.668061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:56.668516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:56.668943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:56.731022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:56.739497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d2a98d3f-f560-4704-9037-4fcca3ed94b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085387 Nov 02 03:50:56.740086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 882/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:56.930961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:56.931567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:56.938091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:56.938576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:56.939013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:56.939708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:56.940192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:56.940621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.011072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:57.019372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:57.020926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:57.022092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c42bc77c-e5c0-4e9a-9003-68a2f4f96a0b tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1657 microversion: 2.20 time: 0.095643 Nov 02 03:50:57.022648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 879/1761] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:50:56 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1657 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:50:57.065318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:57.066030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:57.072240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:57.072759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:57.073204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.073916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:57.074376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:57.074808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.207154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:57.216395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0146d515-b5ef-49a3-a799-2917bd70fe69 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.156971 Nov 02 03:50:57.216975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 883/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:57.526257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226afa75-e26e-405b-b366-e8afb74d7116", "name": "network-vif-deleted", "tag": "c292846c-21ba-4fe5-b336-1db44e16dc9f"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:50:57.542609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:57.543282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:57.543924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.556233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] Creating event network-vif-deleted:c292846c-21ba-4fe5-b336-1db44e16dc9f for instance 226afa75-e26e-405b-b366-e8afb74d7116 on hv-cinder-86020 Nov 02 03:50:57.561377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-d305902b-2455-4d91-934d-c71113294766 req-81c9fc56-c000-4f4e-844c-80a57314dda8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Nov 02 03:50:57.561994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 880/1763] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:50:57.762798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:57.764114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:57.772329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:57.772898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:57.773365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.774231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:57.774856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:57.775289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:57.837701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:57.846170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-95fb97c2-a5b7-4e00-91de-c86ca42652ff tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087205 Nov 02 03:50:57.846840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 884/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:58.048371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:58.049193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:58.056043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.056540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.056979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.057675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.058137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.058569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.090222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.090629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.091073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.091525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lazy-loading 'fault' on Instance uuid 226afa75-e26e-405b-b366-e8afb74d7116 {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:50:58.133341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:58.142393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:58.143896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16c6a2cd8594037ad47475ed1b3161c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f6d222a4d4411b8f4583c61f53129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:58.145054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-075492bd-6fc7-46a7-ad9b-0a50ad321c3d tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 200 len: 1372 microversion: 2.20 time: 0.101004 Nov 02 03:50:58.145617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 881/1765] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:50:58 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 03:50:58.240041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:58.241438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:58.247590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.248101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.248658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.249354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.250077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.250512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.397488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:58.406889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-34d9f30d-99c3-4adc-9c90-d8a1c8e29a3f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.170646 Nov 02 03:50:58.407514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 885/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:58.869588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:58.870210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:58.876936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.877421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.877863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.878831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:58.879292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:58.879722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:58.940425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:58.949039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-690bd637-d790-42c7-8867-236464df9ded tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083897 Nov 02 03:50:58.949599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 882/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:59.170770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:59.171302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:59.177716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.178205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.178640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:59.179323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.179771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.180215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:59.193268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 HTTP/1.1 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:50:59.195390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:50:59.197224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '226afa75-e26e-405b-b366-e8afb74d7116'} Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:50:59.198939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:50:59.200553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:50:59.202002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:50:59.202002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f981ddc7-0725-4553-92be-3f6fcd6ef3dd tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 404 len: 111 microversion: 2.20 time: 0.030052 Nov 02 03:50:59.202002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 886/1768] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:50:59 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 03:50:59.205490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7b98414a-e0de-429c-9fde-16eeed2bf788 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '.version_select at 0x7f5c95c098b0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:59.227047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7b98414a-e0de-429c-9fde-16eeed2bf788 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893488488" status: 204 len: 0 microversion: 2.20 time: 0.025369 Nov 02 03:50:59.227596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 883/1769] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Nov 2 03:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893488488 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 03:50:59.431301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:59.431976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:59.437897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.438452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.438977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:59.439761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.440329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.440823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:59.640890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:50:59.649171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cc1c6fe0-5aec-40f9-8dff-89b6cfa0f7cf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.222321 Nov 02 03:50:59.649730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 887/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:50:59.972692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:50:59.973304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:50:59.980292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.980767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.981200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:50:59.981886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:50:59.982331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:50:59.982749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:00.044449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:00.052562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67eb87e0-f34b-4f55-83dc-82b333c6f2c1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084260 Nov 02 03:51:00.053728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 884/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:50:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:00.672583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:00.673227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:00.680115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:00.680589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:00.681026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:00.681709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:00.682157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:00.682579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:00.810413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:00.818576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-993d0c26-348c-4bf0-95f8-42dd5c3d627b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149879 Nov 02 03:51:00.819157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 888/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:01.075869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:01.076443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:01.083164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:01.083646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:01.084622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:01.085313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:01.085856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:01.086288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:01.101880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:01.149895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:01.158055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-578a59dc-019d-4326-9b42-ae3baa29a8c8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086171 Nov 02 03:51:01.158607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 885/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:01.841445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:01.842001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:01.848386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:01.848861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:01.849289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:01.849970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:01.850443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:01.850862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:01.974363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:01.982886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f47a7a42-77a2-48bc-af75-f831e8d2ad4b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145443 Nov 02 03:51:01.983443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 889/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:02.182561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:02.183111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:02.189539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:02.190022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:02.190462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:02.191147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:02.191610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:02.192058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:02.252153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:02.260287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d704415c-e6b0-4f24-861a-7f18c9355dcd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082315 Nov 02 03:51:02.260840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 886/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:03.006663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:03.007281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:03.013629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:03.014131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:03.014565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:03.015246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:03.015695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:03.016149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:03.147505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:03.155635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-31535767-14c5-4d4b-8898-1ee4a161e6e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152821 Nov 02 03:51:03.156231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 890/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:03 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:03.282223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:03.282798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:03.289887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:03.290374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:03.290822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:03.291563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:03.292044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:03.292476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:03.353624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:03.361777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0abc8f40-0bb6-4352-a35e-3fdb20f3993e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083606 Nov 02 03:51:03.362336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 887/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:04.179202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:04.179870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:04.186427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:04.186901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:04.187362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:04.188073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:04.188519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:04.188945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:04.315893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:04.324013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-541cb7d6-0efd-4f0a-9897-f32271bc9a2d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149290 Nov 02 03:51:04.324561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 891/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:04.384793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:04.385415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:04.391800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:04.392345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:04.392790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:04.393487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:04.393945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:04.394379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:04.454639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:04.462755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-463565f9-cc5e-4d21-9461-4db216d60bfb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081856 Nov 02 03:51:04.463322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 888/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:05.347444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:05.348064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:05.354442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:05.354917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:05.355351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:05.356069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:05.356520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:05.356941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:05.480624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:05.486100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:05.486718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:05.489207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f7d0fb8e-5078-4ed8-95bf-3e446f9ae892 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146321 Nov 02 03:51:05.489907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 892/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:05.493653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:05.494135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:05.494579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:05.495273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:05.495730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:05.496183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:05.557494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:05.565635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7c477d5c-8daa-425e-aa65-8f7b72924325 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083366 Nov 02 03:51:05.566201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 889/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:06.512895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:06.513541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:06.519986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:06.520465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:06.520905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:06.522227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:06.522685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:06.523112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:06.589613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:06.590324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:06.597101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:06.597692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:06.598195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:06.598999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:06.599447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:06.599871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:06.821769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:06.829981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a47feb2f-6481-49cb-8c57-d88b4f42eb7f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.244377 Nov 02 03:51:06.830546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 890/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:06.876522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:06.885362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a0aae6d4-3f1b-429d-b5a6-17109d46a095 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.376407 Nov 02 03:51:06.885926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 893/1783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:07.852596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:07.853151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:07.859475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:07.859971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:07.860413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:07.861094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:07.861544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:07.861965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:07.908218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:07.908837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:07.915793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:07.916309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:07.916749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:07.917437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:07.917893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:07.918317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:07.922798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:07.930852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-651e0308-1180-46ac-9db2-d6ea91b3fba6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082804 Nov 02 03:51:07.931429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 891/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:08.046885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:08.049154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:08.056476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-622d8a0e-25cf-4543-93db-91d9e0d97ce3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152112 Nov 02 03:51:08.057035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 894/1785] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:08.954574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:08.955135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:08.961529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:08.962004 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:08.962438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:08.963124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:08.963578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:08.964018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:09.023940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:09.031884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d89c880b-901f-46cc-b8ed-58877fb648b9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081234 Nov 02 03:51:09.032476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 892/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:09.079214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:09.079818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:09.086612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:09.087088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:09.087516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:09.088226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:09.088673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:09.089092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:09.217843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:09.226576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-24ea9f22-8bae-40d3-ac8b-fb9ef9fc7714 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151398 Nov 02 03:51:09.227125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 895/1787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:09 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:10.055097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:10.055716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:10.062187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:10.062666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:10.063104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:10.063792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:10.064289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:10.064718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:10.124500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:10.133771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5eef3c11-bae1-4085-a966-62d2e38a86f3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083016 Nov 02 03:51:10.134337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 893/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:10.248751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:10.249364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:10.256003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:10.256482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:10.256924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:10.257603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:10.258045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:10.258461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:10.384509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:10.392498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8df401ae-23a1-4e91-8742-f01deeb7b0be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147553 Nov 02 03:51:10.393056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 896/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:10 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:11.156622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:11.157232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:11.163597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:11.164102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:11.164531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:11.165212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:11.165659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:11.166076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:11.226355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:11.234380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-24c61b39-f25e-4a25-8e9b-34a20289b6dd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081680 Nov 02 03:51:11.234936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 894/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:11.415337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:11.415875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:11.422188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:11.422669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:11.423105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:11.423793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:11.424311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:11.424738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:11.553956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:11.562076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e369f42b-a793-4dae-aecb-1040464da6c7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150653 Nov 02 03:51:11.562631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 897/1791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:12.257954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:12.258530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:12.264988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:12.265466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:12.265903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:12.266587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:12.267036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:12.267489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:12.327562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:12.335661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-673370af-ba80-4bd3-8ff2-d57d025495d2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082217 Nov 02 03:51:12.336252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 895/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:12.585595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:12.586204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:12.592719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:12.593196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:12.593628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:12.594314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:12.594762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:12.595187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:12.719448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:12.728121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-48c6f18a-da74-4414-8e6d-ea16f0bf2695 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146430 Nov 02 03:51:12.728679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 898/1793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:13.358182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:13.358797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:13.365432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:13.365907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:13.366339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:13.367030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:13.367521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:13.368214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:13.431763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:13.439816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aac489fa-959f-4c45-96bb-175e807fc54d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085800 Nov 02 03:51:13.440402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 896/1794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:13.751998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:13.752618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:13.759581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:13.760107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:13.760548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:13.761232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:13.761682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:13.762105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:13.885738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:13.893843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ca6943cf-324c-4095-99da-9fd96d72f046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145958 Nov 02 03:51:13.894407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 899/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:14.462742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:14.463475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:14.470010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:14.470493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:14.470936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:14.471631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:14.472120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:14.472547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:14.535928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:14.544791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f169a1b-3aa9-4717-9114-8edd3903d451 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086493 Nov 02 03:51:14.545349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 897/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:14.916958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:14.917507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:14.923718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:14.924218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:14.924651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:14.925327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:14.925773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:14.926187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:15.054688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:15.062754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-726b3925-e6bd-47d2-b560-7a5f591a59a3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149760 Nov 02 03:51:15.063306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 900/1797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:15.567231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:15.567877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:15.574287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:15.574759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:15.575190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:15.575865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:15.576335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:15.576759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:15.636475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:15.644537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-732622f5-0b22-40a1-9da3-63355cabd392 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081187 Nov 02 03:51:15.645089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 898/1798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:16.087400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:16.088037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:16.094420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:16.094898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:16.095334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:16.096044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:16.096496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:16.096919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:16.220492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:16.228560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-004dc157-621b-45cf-b324-af0bd15b3536 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145548 Nov 02 03:51:16.229117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 901/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:16 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:16.667409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:16.668057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:16.674656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:16.675172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:16.675612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:16.676342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:16.676839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:16.677774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:16.741592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:16.750026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a6f04eb7-9da1-4ecd-9156-120c76160ee4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086273 Nov 02 03:51:16.750634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 899/1800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:17.251643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:17.252345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:17.254606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=60 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:17.260107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:17.260586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:17.261024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:17.261708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:17.262159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:17.262584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:17.386159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:17.394193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-536875eb-9c5f-45ef-ba81-3f6aa46df152 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146680 Nov 02 03:51:17.394753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 902/1801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:17 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:17.773181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:17.773830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:17.780328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:17.780754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:17.781187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:17.781875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:17.782325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:17.782747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:17.843136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:17.851267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2c489864-1597-4d16-8312-e43875d5c4af tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082584 Nov 02 03:51:17.851824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 900/1802] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:18.418195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:18.418816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:18.425229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:18.425710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:18.426149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:18.426843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:18.427963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:18.428402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:18.559521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:18.567706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bfa0829e-2c06-4c56-810d-932160e821d0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153505 Nov 02 03:51:18.568300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 903/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:18.873056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:18.873663 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:18.881011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:18.881495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:18.881933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:18.882622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:18.883109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:18.883538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:18.942436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:18.951067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4c0b7da1-976a-4a68-aaa5-f71423460693 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081889 Nov 02 03:51:18.951633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 901/1804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:19.590672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:19.591282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:19.597664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:19.598144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:19.598576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:19.599931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:19.600409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:19.600833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:19.724804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:19.733016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c4a5eba5-4991-4bbd-a794-5dc8171b1f31 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146199 Nov 02 03:51:19.733584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 904/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:19.973623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:19.974246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:19.980742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:19.981227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:19.981666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:19.982363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:19.982820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:19.983846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:19.987705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:20.047921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:20.056665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a5fd7fd-53d5-47db-b22b-534fc7a7b132 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086900 Nov 02 03:51:20.057224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 902/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:20.756121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:20.756742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:20.763133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:20.763612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:20.764144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:20.764836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:20.765299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:20.765723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:20.890449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:20.899087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ceb9f3c5-09cf-46b9-8427-2a3e7b5b0b80 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146929 Nov 02 03:51:20.899649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 905/1807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:21.079864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:21.080506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:21.087474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:21.087972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:21.088409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:21.089089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:21.089538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:21.089957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:21.153573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:21.161697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a43443ca-ccb4-4889-9e95-70168b00b891 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085661 Nov 02 03:51:21.162254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 903/1808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:21.925158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:21.925684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:21.932626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:21.933092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:21.933527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:21.934204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:21.934647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:21.935063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:22.063469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:22.071598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8d4cc815-fe7d-4488-93f5-9138dd4629a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150419 Nov 02 03:51:22.072183 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 906/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:22.184190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:22.184723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:22.191155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:22.191631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:22.192092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:22.192778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:22.193236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:22.193675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:22.255519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:22.263550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a5dd41b-4900-4023-a8b6-9fb909d84cd5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083297 Nov 02 03:51:22.264137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 904/1810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:23.095024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:23.095590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:23.101914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:23.102386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:23.102819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:23.103494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:23.103943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:23.104382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:23.229069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:23.237202 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fb089019-7093-46eb-a05c-5061aefb3106 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146242 Nov 02 03:51:23.237762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 907/1811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:23 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:23.286572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:23.287295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:23.293641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:23.294125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:23.294568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:23.295259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:23.295714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:23.296170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:23.360483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:23.369409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-054c1f0e-91a8-4eae-b036-db38d258b8aa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086701 Nov 02 03:51:23.369975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 905/1812] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:24.260534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:24.261147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:24.266960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:24.267439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:24.267874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:24.268588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:24.269036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:24.269460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:24.392803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:24.393441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:24.393567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:24.400517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:24.401000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:24.401473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:24.402187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:24.402311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cab5d4f9-ae80-45ac-b824-64e6e115483a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145777 Nov 02 03:51:24.402643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:24.402833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 908/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:24 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:24.403075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:24.470222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:24.478255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4d92007b-81f8-4b73-a975-c3c8a5b3d9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.090255 Nov 02 03:51:24.478818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 906/1814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:25.425605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:25.426222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:25.432642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:25.433115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:25.433548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:25.434229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:25.434677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:25.435100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:25.502613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:25.503393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:25.505842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:25.511916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:25.512426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:25.512857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:25.513556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:25.514000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:25.514419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:25.586963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:25.590584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:25.595377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f4cc8308-9fa9-46ab-9d24-a85552d7b6d0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.096928 Nov 02 03:51:25.595964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 907/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:25.599030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e609424f-a311-4fa3-976a-4c7867d225b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.177236 Nov 02 03:51:25.599581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 909/1816] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:26.618499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:26.619122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:26.622388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:26.623071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:26.626033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:26.626518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:26.626957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:26.627651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:26.628133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:26.628558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:26.629651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:26.630153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:26.630584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:26.631263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:26.631705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:26.632150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:26.709703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:26.717875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f151c166-e652-4c69-8134-95b067f9a59b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.103882 Nov 02 03:51:26.718437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 908/1817] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:26.778759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:26.787581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f9e40c22-ac74-4e52-a271-8bb6bbfcd2ed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.169178 Nov 02 03:51:26.788171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 910/1818] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:27.741976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:27.742586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:27.748790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:27.749265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:27.749695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:27.750653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:27.751099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:27.751515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:27.810531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:27.810987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:27.811172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:27.818282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:27.818771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:27.819210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:27.819847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e626ccf0-68aa-4181-9077-10b8b469eb29 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082334 Nov 02 03:51:27.820000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:27.820376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:27.820519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 909/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:27.820882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:27.836012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:27.946662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:27.954765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b949ff83-7bb2-48ea-bfbf-5cab25cbb821 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148239 Nov 02 03:51:27.955332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 911/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:28.842574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:28.843144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:28.850050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:28.850533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:28.850973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:28.851667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:28.852156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:28.852586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:28.916330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:28.924487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-168b01fe-5b4d-4463-96e4-7aedff8a35c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085896 Nov 02 03:51:28.925051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 910/1821] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:28.978253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:28.978910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:28.985257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:28.985732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:28.986170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:28.986855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:28.987310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:28.987732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:29.113155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:29.121346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d806c9c8-33a1-4fac-ba86-51c402c89396 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147381 Nov 02 03:51:29.121899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 912/1822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:29.947494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:29.948211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:29.954550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:29.955031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:29.955470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:29.956192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:29.956652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:29.957084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:30.018755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:30.026846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-88cceb77-6eda-49f3-9ca2-522ab5757607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083237 Nov 02 03:51:30.027407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 911/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:30.144734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:30.145273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:30.151567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:30.152082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:30.152510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:30.153186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:30.153631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:30.154047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:30.280826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:30.289582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d25a4017-7286-4be7-a249-b9e83e8108f5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148935 Nov 02 03:51:30.290133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 913/1824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:30 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:31.048511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:31.049122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:31.055536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:31.056059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:31.056499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:31.057188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:31.057639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:31.058063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:31.118575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:31.127013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-be111b9f-0d81-4641-801c-3e530eda75e5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082417 Nov 02 03:51:31.127572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 912/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:31.313260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:31.313826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:31.320787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:31.321260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:31.321690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:31.322366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:31.322808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:31.323224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:31.451031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:31.459137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a951dbb1-4dc3-45ae-a129-ceb8b26997bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149793 Nov 02 03:51:31.459695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 914/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:32.150122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:32.150763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:32.157386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:32.157898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:32.158331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:32.159015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:32.159465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:32.159911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:32.224707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:32.232834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f9a7360e-410f-4f4e-977f-bcd68848ef7c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087137 Nov 02 03:51:32.233402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 913/1827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:32.482045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:32.482658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:32.489077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:32.489553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:32.489986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:32.490670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:32.491120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:32.491542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:32.616772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:32.625203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d4c3805-f4e2-44a2-b3f8-c0fa38b99697 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146779 Nov 02 03:51:32.625757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 915/1828] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:33.254880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:33.255548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:33.262171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:33.262655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:33.263092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:33.263783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:33.264277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:33.264704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:33.325275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:33.333415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-174b0118-a815-4f88-aea8-f3ee80697963 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082416 Nov 02 03:51:33.333971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 914/1829] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:33.649121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:33.649776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:33.656177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:33.656652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:33.657087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:33.657770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:33.658219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:33.658637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:33.789647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:33.797722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-158da949-615d-4f93-9431-eced31291d00 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153006 Nov 02 03:51:33.798284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 916/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:34.355974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:34.356614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:34.363121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:34.363605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:34.364630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:34.365338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:34.365804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:34.366234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:34.426259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:34.435058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ec5459f3-970d-4869-a43c-b61310d3bd2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083024 Nov 02 03:51:34.435618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 915/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:34.820838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:34.821445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:34.827775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:34.828275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:34.828708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:34.829389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:34.829835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:34.830251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:34.955435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:34.963518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-113e5d42-f420-41ed-a4d5-984a832d4840 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146587 Nov 02 03:51:34.964092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 917/1832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:35.458885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:35.459421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:35.465756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:35.466230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:35.466665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:35.467356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:35.467806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:35.468255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:35.531377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:35.539720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21a64cd7-a377-4d14-91b6-c3339bf74944 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085303 Nov 02 03:51:35.540301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 916/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:35.986879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:35.987499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:35.993899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:35.994388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:35.994821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:35.995540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:35.996014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:35.996441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:36.120697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:36.129073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b8d093f-3e19-4a99-9834-d7b0bcfeadda tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146105 Nov 02 03:51:36.129632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 918/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:35 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:36.562434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:36.563109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:36.570127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:36.570610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:36.571065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:36.571742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:36.572298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:36.572729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:36.635942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:36.644182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-59d747c6-1911-4c93-8121-e7a46b2ad6d6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085763 Nov 02 03:51:36.644816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 917/1835] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:37.152475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:37.153113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:37.159421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:37.159894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:37.160354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:37.161528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:37.161974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:37.162393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:37.293199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:37.301314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9b8db6f7-b015-4a2d-84b3-d591f89eb834 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152994 Nov 02 03:51:37.301869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 919/1836] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:37.666521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:37.667137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:37.673482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:37.673963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:37.674403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:37.675091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:37.675552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:37.675996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:37.736765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:37.738957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:37.746154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d12e3b0f-4e4f-4510-8619-4a8034849315 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083482 Nov 02 03:51:37.746717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 918/1837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:38.324554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:38.325170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:38.331535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:38.332045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:38.332489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:38.333175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:38.333624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:38.334047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:38.465694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:38.474543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c331d15f-31d1-438c-8987-d0c76ec2e211 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153863 Nov 02 03:51:38.475108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 920/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:38.769431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:38.770048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:38.777027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:38.777505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:38.777946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:38.778638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:38.779090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:38.779560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:38.843455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:38.852435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cb28d7d5-9ce3-4327-b135-c0eed5cd5575 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086927 Nov 02 03:51:38.853003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 919/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:39.497114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:39.497727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:39.504434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:39.505415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:39.505848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:39.506535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:39.506984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:39.507407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:39.633281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:39.641498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18e3bc97-1545-448c-a4a2-ca3bace02f56 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148264 Nov 02 03:51:39.642055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 921/1840] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:39.876636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:39.877280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:39.884368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:39.884851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:39.885290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:39.885979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:39.886430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:39.886859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:39.946831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:39.954974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3327e229-b1cf-4e97-988a-ae4341a4987b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082440 Nov 02 03:51:39.955541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 920/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:40.665046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:40.665664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:40.672020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:40.672497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:40.672929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:40.673613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:40.674063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:40.674479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:40.800678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:40.808770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f6c17fe8-7730-4582-8010-235d50e8b2ad tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148169 Nov 02 03:51:40.809337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 922/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:40.977649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:40.978287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:40.984865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:40.985357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:40.985793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:40.986485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:40.986936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:40.987360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:41.048290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:41.056561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8dd86159-e308-4c93-bc9e-c47105d3804a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083344 Nov 02 03:51:41.057066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 921/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:41.830647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:41.831175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:41.838218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:41.838696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:41.839133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:41.839817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:41.840291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:41.840716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:41.968373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:41.976451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fc07a320-c2b0-4e84-8ce3-e27d10dae78f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149756 Nov 02 03:51:41.977010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 923/1844] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:42.079469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:42.080109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:42.087107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:42.087529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:42.087975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:42.088674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:42.089129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:42.089547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:42.153151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:42.161210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5440f8ee-4752-4c60-adc0-dd736e8e99e3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085612 Nov 02 03:51:42.161766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 922/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:42.999682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:43.000695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:43.007971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:43.008452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:43.009219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:43.009907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:43.010353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:43.010780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:43.137859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:43.147168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-befe5bf8-ed2f-4708-8290-8862319b3624 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151689 Nov 02 03:51:43.147724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 924/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:42 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:43.184176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:43.184799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:43.191118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:43.191601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:43.192067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:43.192764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:43.193305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:43.193737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:43.262028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:43.270199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cecea15e-e3a7-4e30-bd09-79aef5ff4b4e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089983 Nov 02 03:51:43.270768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 923/1847] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:44.170429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:44.171165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:44.177570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:44.178048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:44.178480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:44.179168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:44.179622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:44.180069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:44.293395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:44.293953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:44.300346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:44.300835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:44.301277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:44.301976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:44.302430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:44.302861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:44.310234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:44.318819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0c5fd29a-854a-4cc0-a402-6fe5cc51c12c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151850 Nov 02 03:51:44.319386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 925/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:44.365432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:44.373838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9e856e2f-8ebd-4f14-9850-adb79e685631 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084435 Nov 02 03:51:44.374391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 924/1849] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:45.342668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:45.343296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:45.349677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:45.350149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:45.350575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:45.351286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:45.351728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:45.352177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:45.397052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:45.397678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:45.404166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:45.404652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:45.405093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:45.405823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:45.406283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:45.406713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:45.481323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:45.489728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4577fd15-2c94-4856-9c98-5946cc62c364 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.096564 Nov 02 03:51:45.491201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 925/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:45.502431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:45.510761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c15c9c1-e946-465a-acc4-df5e46dfcb27 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.172086 Nov 02 03:51:45.511312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 926/1851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:46.513470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:46.514081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:46.520440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:46.520919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:46.521878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:46.522563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:46.523011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:46.523432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:46.533280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:46.534479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:46.541130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:46.541608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:46.542043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:46.542738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:46.543215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:46.543642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:46.590503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:46.598949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-511856c9-047a-4696-9f40-d38e34199a2a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089362 Nov 02 03:51:46.599526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 926/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:46.682290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:46.690439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cca15940-64b7-4c6a-a2ce-cbfbd029fd05 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.160998 Nov 02 03:51:46.691007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 927/1853] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:47.621074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:47.621687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:47.628338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:47.628817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:47.629256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:47.629946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:47.630401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:47.630826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:47.690491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:47.699015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8635e4f4-0836-4700-8684-00dba746cef1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081842 Nov 02 03:51:47.699584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 927/1854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:47.714930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:47.715536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:47.717828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:47.722991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:47.723463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:47.723891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:47.725201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:47.725644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:47.726063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:47.728764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:47.854443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:47.862435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-02c5008d-4bc5-4aeb-883e-810626d5d94f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151347 Nov 02 03:51:47.862994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 928/1855] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:48.721943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:48.722554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:48.729273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:48.729747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:48.730178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:48.730856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:48.731305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:48.731726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:48.791559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:48.799603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aa10ad71-1d80-4b70-a55f-efdfa5e20941 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081518 Nov 02 03:51:48.800189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 928/1856] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:48.885945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:48.886554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:48.892924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:48.893395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:48.893824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:48.894507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:48.894952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:48.895368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:49.021139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:49.029253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6b0be4d1-dabd-40dd-9ef3-edc47fcff855 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147105 Nov 02 03:51:49.029805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 929/1857] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:49.822580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:49.823123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:49.829441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:49.829914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:49.830344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:49.831024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:49.831471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:49.831890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:49.897792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:49.905945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-62fd06ea-ebd6-4261-94de-e1de2a6a7883 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087330 Nov 02 03:51:49.906504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 929/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:50.052015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:50.052627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:50.058983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:50.059460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:50.059897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:50.060627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:50.061076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:50.061498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:50.185396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:50.193622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-47757905-b8e9-42c8-96e4-5feadaf33fa9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145537 Nov 02 03:51:50.194677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 930/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:50 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:50.929664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:50.930305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:50.936683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:50.937161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:50.937597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:50.938284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:50.938734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:50.939162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:50.999204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:51.007799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6272cb5d-f120-4e2d-9174-a087f9bb51c7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082633 Nov 02 03:51:51.008386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 930/1860] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:51.216978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:51.217575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:51.223905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:51.224411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:51.224849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:51.226152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:51.226628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:51.227023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:51.356728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:51.366332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-499dcc11-ee4c-4e18-a0cd-7ce4bb44bf78 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153164 Nov 02 03:51:51.366901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 931/1861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:52.030209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:52.030846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:52.037226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:52.037706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:52.038137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:52.038822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:52.039270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:52.039692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:52.099524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:52.107535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48a24b09-2ef0-4ff8-bcaf-6303095ff34c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081182 Nov 02 03:51:52.108121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 931/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:52.389523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:52.390082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:52.396499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:52.396972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:52.397408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:52.398089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:52.398539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:52.398959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:52.521449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:52.530240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c28387d5-2184-41a3-82de-87c366a4cc4f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144307 Nov 02 03:51:52.530477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 932/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:53.131356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:53.132519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:53.138869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:53.139354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:53.139791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:53.140517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:53.140973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:53.141396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:53.204834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:53.213801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6242344e-7772-4456-8e40-78ecfeb22c0a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086425 Nov 02 03:51:53.214369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 932/1864] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:53.553551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:53.554226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:53.560603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:53.561074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:53.561509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:53.562181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:53.562625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:53.563043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:53.686420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:53.694516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eceed9ba-0a82-4ea4-9d33-26aa0d28c77e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144819 Nov 02 03:51:53.695074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 933/1865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:54.237710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:54.238433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:54.245329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:54.245812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:54.246256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:54.246950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:54.247407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:54.247831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:54.308997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:54.317585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23665905-3f34-4593-b02b-74fa7811b33b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083723 Nov 02 03:51:54.318156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 933/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:54.717689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:54.718299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:54.724486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:54.724965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:54.725405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:54.726087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:54.726535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:54.726960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:54.853572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:54.861709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5ef6436e-f710-49a3-89e4-bb550f42c4bf tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148071 Nov 02 03:51:54.862274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 934/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:55.339864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:55.340529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:55.346990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:55.347472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:55.347928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:55.348621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:55.349075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:55.349529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:55.410015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:55.418659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fdeec4a2-135b-4a50-aa65-e92af8064b2b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082679 Nov 02 03:51:55.419219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 934/1868] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:55.885437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:55.886051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:55.892490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:55.892971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:55.893408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:55.894098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:55.894807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:55.895244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:56.019621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:56.028461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-df1ebadf-bad2-47f4-b99b-8b23c7d2e2ba tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146901 Nov 02 03:51:56.029023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 935/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:56.441806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:56.442353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:56.445230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=56 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:56.450193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:56.450711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:56.451129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:56.451844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:56.452330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:56.452760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:56.467688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:51:56.519745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:56.528328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-61db17e1-ae18-4830-9494-7964a1050b43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.090422 Nov 02 03:51:56.528901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 935/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:57.051098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:57.051726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:57.058795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:57.059277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:57.060134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:57.060414 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:57.060893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:57.061288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:57.189166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:57.197339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-24f91115-6a07-4f60-b904-bd0351be660b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150042 Nov 02 03:51:57.197920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 936/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:51:57.550637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:57.551284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:57.557388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:57.557869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:57.558307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:57.558997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:57.559457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:57.559893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:57.620372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:57.628914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-99cf0239-96e0-458d-8a38-d1a3751c57e7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082190 Nov 02 03:51:57.629480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 936/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:58.221244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:58.221871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:58.228781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:58.229259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:58.229693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:58.230382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:58.230829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:58.231246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:58.358055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:58.366848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2013e6f5-5680-43ea-ba90-2a25528a7c33 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149711 Nov 02 03:51:58.367402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 937/1873] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:58.652352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:58.652967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:58.659302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:58.659778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:58.660242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:58.660925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:58.661379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:58.661800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:58.721720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:58.730458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d409b2e5-6f47-440d-8ca9-e23546f71a73 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081970 Nov 02 03:51:58.731013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 937/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:59.389870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:59.390483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:59.396853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:59.397393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:59.397843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:59.398509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:59.398954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:59.399373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:59.523230 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:59.531482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9012fb80-0817-4ff5-9b1f-c5ed2b6a95d6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145509 Nov 02 03:51:59.532357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 938/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:51:59.753096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:51:59.753708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:51:59.760168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:59.760645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:59.761084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:59.761767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:51:59.762224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:51:59.762640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:51:59.826607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:51:59.834707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5335d43c-7e18-4471-a1c2-978fb1f2942d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085694 Nov 02 03:51:59.835257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 938/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:51:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:00.554445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:00.555062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:00.561404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:00.561898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:00.562321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:00.563007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:00.563462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:00.563882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:00.688306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:00.696877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3938e51d-f40f-4baa-9413-978430bc8c5f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146307 Nov 02 03:52:00.697434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 939/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:00.856531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:00.857070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:00.863319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:00.863800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:00.864277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:00.864958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:00.865407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:00.866318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:00.926260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:00.934775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-02214168-5b7d-4847-88e4-9c4154627b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082152 Nov 02 03:52:00.935334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 939/1878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:01.720047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:01.720666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:01.722607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:52:01.722753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 (ip 10.222.0.26) !!! Nov 02 03:52:01.734188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:01.734662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:01.735091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:01.735771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:01.736251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:01.736670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:01.864219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:01.872369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7642dcb5-4b45-431b-b498-b1aee53c2873 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.156528 Nov 02 03:52:01.872930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 940/1879] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:01.957551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:01.958163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:01.964949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:01.965443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:01.965855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:01.966535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:01.966996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:01.967399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:02.027886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:02.036091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-085d8185-6dca-4ba6-8201-73f6bf1e9ccd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082314 Nov 02 03:52:02.036659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 940/1880] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:02.895631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:02.896221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:02.902545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:02.903021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:02.903458 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:02.904171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:02.904623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:02.905047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:03.029695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:03.038323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8ecff17-7926-44a7-9939-5d61537af489 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146193 Nov 02 03:52:03.038886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 941/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:02 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:03.058957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:03.059576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:03.065955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:03.066432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:03.066872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:03.067560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:03.068068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:03.068501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:03.131521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:03.140494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0eb3b797-94be-459c-90fd-3153b42f0ad2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085349 Nov 02 03:52:03.141088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 941/1882] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:04.061362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:04.061971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:04.068297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:04.069432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:04.069864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:04.070545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:04.070989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:04.071407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:04.163725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:04.164371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:04.170705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:04.171192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:04.171631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:04.172358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:04.172812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:04.173239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:04.196629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:04.204754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-252d7172-69fc-43ca-ac75-02d50e04364e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147251 Nov 02 03:52:04.205318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 942/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:04.235390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:04.244209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-47522931-fb69-43e8-8d3b-6fe6564439dc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084336 Nov 02 03:52:04.244775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 942/1884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:05.227974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:05.228577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:05.235123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:05.235608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:05.236070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:05.236768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:05.237247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:05.237673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:05.266977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:05.267595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:05.274029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:05.274514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:05.274953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:05.275645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:05.276136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:05.276563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:05.345659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:05.354535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3513c526-9744-4f21-b99e-aefd9b17948f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.091451 Nov 02 03:52:05.355099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 943/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:05.400675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:05.408897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-449112e1-9e62-4145-8723-6494be73b22e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.185305 Nov 02 03:52:05.409464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 943/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:06.377239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:06.377865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:06.384906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:06.385388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:06.385833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:06.386528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:06.386986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:06.387416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:06.432556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:06.433259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:06.440067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:06.440436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:06.441128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:06.441545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:06.441993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:06.442413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:06.449781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:06.458106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f97bd1f9-c2a7-43c5-99f3-e044a15d9495 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084986 Nov 02 03:52:06.458686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 944/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:06.575074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:06.577297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:06.584751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-922ec418-43c4-42ef-9b98-181e9e95a2d5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.156615 Nov 02 03:52:06.585320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 944/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:07.481129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:07.481777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:07.488499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:07.488978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:07.489408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:07.490108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:07.490832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:07.490951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:07.552847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:07.561197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21b4d371-c17f-4a95-8e4f-122ecc3ed808 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083957 Nov 02 03:52:07.561761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 945/1889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:07.607777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:07.608420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:07.614807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:07.615277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:07.616238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:07.616920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:07.617363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:07.617779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:07.743288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:07.751669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-23b29158-4d45-47df-86cd-31c3bc60cb91 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147762 Nov 02 03:52:07.752253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 945/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:08.584697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:08.585352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:08.591965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:08.592480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:08.592923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:08.593611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:08.594064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:08.594733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:08.656984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:08.665724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ec3d6d37-1545-4e73-bc34-166d3d99d87f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085456 Nov 02 03:52:08.666287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 946/1891] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:08.775902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:08.776542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:08.783024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:08.783442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:08.783873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:08.784582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:08.785032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:08.785455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:08.909452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:08.917554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b82ade80-8302-4f56-8603-939fff1fa3fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146166 Nov 02 03:52:08.918104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 946/1892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:08 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:09.688267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:09.688885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:09.695270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:09.695750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:09.696222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:09.696909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:09.697364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:09.697794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:09.757794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:09.765800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6ddf9827-f219-4ffb-b01a-ed27d542b49f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081478 Nov 02 03:52:09.766362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 947/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:09.940544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:09.941073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:09.947508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:09.948010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:09.948450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:09.949134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:09.949586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:09.950007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:10.077682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:10.086289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3f041461-7997-4ef0-9e83-78e378da6432 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149712 Nov 02 03:52:10.086858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 947/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:09 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:10.788451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:10.789003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:10.795320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:10.795790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:10.796250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:10.796934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:10.797382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:10.797803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:10.860404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:10.868513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b0b320ca-1c41-4dda-928e-bf5f80b8c038 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084632 Nov 02 03:52:10.869077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 948/1895] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:11.109777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:11.110304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:11.116661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:11.117136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:11.117570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:11.118259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:11.118707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:11.119130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:11.242172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:11.250433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c0e2d025-c6d1-4e65-aca0-6958a206ed1d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144373 Nov 02 03:52:11.250992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 948/1896] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:11.891508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:11.892154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:11.899189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:11.899671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:11.900145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:11.900833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:11.901288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:11.901714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:11.963900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:11.972053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-36933f31-fc1e-4a9a-86c4-b04cd25b50d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084379 Nov 02 03:52:11.972606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 949/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:12.272714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:12.273322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:12.279605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:12.280108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:12.280538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:12.281216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:12.281656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:12.282071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:12.408108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:12.416248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e2193343-efcc-410f-b745-46a5764bd334 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147343 Nov 02 03:52:12.416805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 949/1898] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:12.993887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:12.994498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:13.001037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:13.001514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:13.001947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:13.002629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:13.003078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:13.003500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:13.063044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:13.071068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-69417a06-39c2-41d8-9e91-7a7b6320d978 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081126 Nov 02 03:52:13.071623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 950/1899] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:13.438971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:13.439566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:13.446452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:13.446919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:13.447350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:13.448054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:13.448526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:13.448939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:13.575281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:13.583405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2fb7be07-3994-4aaa-ab64-8375534d5117 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148262 Nov 02 03:52:13.583977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 950/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:14.093468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:14.094092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:14.101027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:14.101502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:14.101939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:14.102623 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:14.103079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:14.103502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:14.163349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:14.171473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-68a72c7f-2823-419a-9432-c85318ee6e68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081868 Nov 02 03:52:14.172056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 951/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:14.607211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:14.607810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:14.614132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:14.614610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:14.615048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:14.615724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:14.616199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:14.616619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:14.739915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:14.748068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f84d868f-5721-434a-bb25-ad4723aaff82 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144686 Nov 02 03:52:14.748632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 951/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:15.194584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:15.195197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:15.197257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:52:15.197403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:52:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:52:15.204738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:15.205222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:15.205661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:15.206353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:15.206808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:15.207234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:15.210583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:15.272190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:15.280332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3e787fce-a666-4e9f-a766-ddcc6b56341a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089638 Nov 02 03:52:15.280898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 952/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:15.771746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:15.772417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:15.778784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:15.779306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:15.779687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:15.780391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:15.780840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:15.781253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:15.906745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:15.915594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c384b171-dcb8-4c6f-8a5b-62ccb5f7f717 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147692 Nov 02 03:52:15.916182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 952/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:15 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:16.303331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:16.303994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:16.310739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:16.311221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:16.311656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:16.312375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:16.312819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:16.313240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:16.372801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:16.381075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-833579a4-e8c0-4fc3-b0c3-b4a9664e6f3f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081836 Nov 02 03:52:16.382134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 953/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:16.938460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:16.939006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:16.946037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:16.946507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:16.946939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:16.947613 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:16.948057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:16.948500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:17.280898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:17.289609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e59ee75a-8236-4e34-9674-e1e9d56a30b8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.355087 Nov 02 03:52:17.290176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 953/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:16 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:17.404201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:17.404844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:17.411223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:17.411704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:17.412168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:17.413515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:17.413972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:17.414399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:17.476096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:17.484203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9fe08426-2e76-42ac-95cd-47ca000d2002 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083827 Nov 02 03:52:17.484764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 954/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:18.312887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:18.313563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:18.315938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:18.321737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:18.322210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:18.322646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:18.323333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:18.323784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:18.324238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:18.447735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:18.455908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f24fbd8-f302-4619-bd17-37b868bceb03 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146896 Nov 02 03:52:18.456494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 954/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:18.506573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:18.507193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:18.513587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:18.514067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:18.514532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:18.515222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:18.515682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:18.516163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:18.578879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:18.587002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bbb3ca45-0231-4e3a-80ea-7c81a4a2e001 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084280 Nov 02 03:52:18.587565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 955/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:19.478968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:19.479584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:19.485970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:19.486449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:19.486883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:19.487568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:19.488048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:19.488470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:19.610583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:19.611200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:19.611867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:19.618235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:19.618685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:19.619121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:19.619922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:19.620297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:19.620652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-54a451e5-bcd4-4242-9e1a-e8cb85940fc7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145507 Nov 02 03:52:19.620766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:19.621218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 955/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:19.680650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:19.688632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3609f541-fec5-4622-b5cc-2ba1c6ed8d84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081912 Nov 02 03:52:19.689194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 956/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:20.644081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:20.644703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:20.651610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:20.652134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:20.652577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:20.653275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:20.653737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:20.654167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:20.713129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:20.713838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:20.720272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:20.720749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:20.721396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:20.722096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:20.722550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:20.722979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:20.788470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:20.796646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-66725d64-ac2c-46e5-b0bb-5313fc39cb30 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088067 Nov 02 03:52:20.797219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 957/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:20.808759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:20.817522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a41ff53b-3f56-4305-98b8-a3b58cc7ee37 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.177342 Nov 02 03:52:20.818081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 956/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:21.818740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:21.819357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:21.825874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:21.826356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:21.826795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:21.827484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:21.827941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:21.828389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:21.841481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:21.842088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:21.848328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:21.848798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:21.849227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:21.849907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:21.850347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:21.850761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:21.891728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:21.900682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-06c329ed-177f-45ea-86ba-3d5165f9c4de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085759 Nov 02 03:52:21.901257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 958/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:21.985467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:21.993709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f3e7937d-d10f-40d2-b4fc-19aa8d466a51 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.156015 Nov 02 03:52:21.994268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 957/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:22.923748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:22.924384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:22.931346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:22.931852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:22.932338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:22.933021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:22.933467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:22.933911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:22.996585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:23.004874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-560bb2e3-4046-477e-b71b-88bca8409b85 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084995 Nov 02 03:52:23.005428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 959/1916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:23.016685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:23.017303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:23.023784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:23.024304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:23.024744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:23.025436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:23.025888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:23.026315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:23.149279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:23.157439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f998a69a-0d51-4e54-8a71-f27950d323a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144606 Nov 02 03:52:23.157996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 958/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:23 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:24.028096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:24.028740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:24.035080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:24.035560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:24.036020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:24.036714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:24.037168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:24.037593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:24.099764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:24.108436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-40fa8232-7a37-48f1-9480-a0fb222120b5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084709 Nov 02 03:52:24.109000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 960/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:24.182654 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:24.183271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:24.189252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:24.189730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:24.190167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:24.190857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:24.191315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:24.191736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:24.321241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:24.329396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-34ecb10a-bce4-4535-a278-fdff835319a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150743 Nov 02 03:52:24.329957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 959/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:24 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:25.130451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:25.131054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:25.138045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:25.138522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:25.138950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:25.139629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:25.140107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:25.140529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:25.200148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:25.208258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0625921f-4df6-430c-ba88-5b1291518e02 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081641 Nov 02 03:52:25.208812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 961/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:25.352881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:25.353500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:25.359847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:25.360359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:25.360794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:25.361482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:25.361931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:25.362354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:25.487007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:25.495741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e4e16f9f-2b80-49d5-aa6e-6456e65e535f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147238 Nov 02 03:52:25.496332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 960/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:26.230648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:26.231247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:26.237624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:26.238100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:26.238530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:26.239210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:26.239658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:26.240105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:26.302801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:26.311451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a50079dd-3181-4c55-857e-26bb0934c9b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084630 Nov 02 03:52:26.312003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 962/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:26.518622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:26.519165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:26.525599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:26.526078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:26.526515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:26.527206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:26.527658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:26.528113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:26.542637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:26.565482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:52:26.565712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 (ip 10.222.0.26) !!! Nov 02 03:52:26.655682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:26.663763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-faa97dc0-1ed0-47d9-8cf2-636c8ea01fc9 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149034 Nov 02 03:52:26.664857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 961/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:27.334582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:27.335192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:27.337713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=56 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:27.343125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:27.343601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:27.344057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:27.344737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:27.345182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:27.345598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:27.406306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:27.415166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-689eea51-5e7b-405d-81d9-0f59db244979 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084483 Nov 02 03:52:27.415736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 963/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:27.686759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:27.687307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:27.693756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:27.694235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:27.694670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:27.695860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:27.696338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:27.696761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:27.826241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:27.834320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-00dd3d0e-7d57-45f4-9773-e56cf8d3ef50 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151582 Nov 02 03:52:27.834890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 962/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:28.437592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:28.438232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:28.444859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:28.445361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:28.445791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:28.446471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:28.446918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:28.447336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:28.507504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:28.515700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-582ea290-0a90-42b9-b337-5b2962fb7628 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081964 Nov 02 03:52:28.516288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 964/1926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:28.857002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:28.857621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:28.863979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:28.864460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:28.864891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:28.865568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:28.866016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:28.866433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:28.991565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:28.999660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87995dce-c8dc-4c50-8f45-9066e1fe3f30 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147161 Nov 02 03:52:29.000537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 963/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:29.538732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:29.540160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:29.546604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:29.547077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:29.547510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:29.548228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:29.548675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:29.549092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:29.612124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:29.620257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-04a20b4d-c10d-45e5-b0f1-296b18852c7e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085480 Nov 02 03:52:29.620815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 965/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:30.023285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:30.024525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:30.030824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:30.031303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:30.031739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:30.032453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:30.032904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:30.033328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:30.157749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:30.165937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3d63bc08-c3c5-446d-8d36-084c2f648f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146517 Nov 02 03:52:30.166497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 964/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:30 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:30.642633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:30.643252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:30.649799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:30.650276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:30.650714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:30.651400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:30.651853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:30.652308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:30.712237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:30.720228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21c078d9-9ae3-48e1-b79b-842121d16a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081454 Nov 02 03:52:30.720786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 966/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:31.188463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:31.189084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:31.195555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:31.196587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:31.197019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:31.197701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:31.198152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:31.198572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:31.325912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:31.334037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0da2b808-f524-41dc-9632-90f13d74b7c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149395 Nov 02 03:52:31.334586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 965/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:31.743913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:31.744540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:31.751165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:31.751638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:31.752168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:31.752854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:31.753301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:31.753724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:31.815584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:31.824458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b3dfb02b-4be5-4779-bdee-40bb80cb93cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085017 Nov 02 03:52:31.825014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 967/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:32.357922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:32.358537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:32.364909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:32.365386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:32.365818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:32.366494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:32.366938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:32.367356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:32.490690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:32.498760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b9da245e-75c3-4d3d-b1c5-78c965451fc8 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144703 Nov 02 03:52:32.499312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 966/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:32.846559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:32.847174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:32.853562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:32.854038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:32.854473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:32.855164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:32.855614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:32.856061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:32.920719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:32.922889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:32.930042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9d7ca66e-c85f-418a-966e-a92b9d95f957 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087307 Nov 02 03:52:32.930609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 968/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:33.522026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:33.522695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:33.529216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:33.529944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:33.530117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:33.530805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:33.531256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:33.531679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:33.657001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:33.665649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d0b4459f-c814-41b0-acd8-8c823b1a7ca6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147502 Nov 02 03:52:33.666216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 967/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:33.952953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:33.953489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:33.959822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:33.960328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:33.960780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:33.961962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:33.962413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:33.962832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:34.022781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:34.031361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-09a651ee-5280-4f1a-96c4-fd2b605000b8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082306 Nov 02 03:52:34.031914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 969/1936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:34.689093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:34.689706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:34.696629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:34.697098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:34.697527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:34.698205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:34.698648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:34.699064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:34.827029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:34.835190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7a09d55b-4255-4258-8037-ca2ba3b85ec6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150010 Nov 02 03:52:34.835756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 968/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:35.054852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:35.056058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:35.062371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:35.062845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:35.063278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:35.063980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:35.064427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:35.064848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:35.124679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:35.132877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b25e8b23-3bcd-4bd8-a28a-564e537344c5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081850 Nov 02 03:52:35.133459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 970/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:35.858109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:35.858652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:35.865022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:35.865501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:35.865937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:35.866619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:35.867068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:35.867488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:35.992175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:36.000581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-605bed1b-f7ae-46a2-96ff-a678cff2423f tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146444 Nov 02 03:52:36.001146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 969/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:35 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:36.155061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:36.155604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:36.161990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:36.162465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:36.162898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:36.163575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:36.164050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:36.164474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:36.227692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:36.235787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3cf23770-7321-4137-8d40-0b1b165da895 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084626 Nov 02 03:52:36.236373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 971/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:37.024508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:37.025151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:37.031486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:37.031980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:37.032415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:37.033092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:37.033536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:37.033951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:37.160102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:37.168383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-baf8d336-a5b5-4eae-9d1c-66eb0f7e477d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148391 Nov 02 03:52:37.168935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 970/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:37.259825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:37.260481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:37.266891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:37.267366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:37.267796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:37.268526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:37.269054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:37.269478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:37.329374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:37.338051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d3f1fbe4-79fb-409e-9341-5fe85d5c9ced tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082584 Nov 02 03:52:37.338605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 972/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:38.191142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:38.191734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:38.198243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:38.198716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:38.199146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:38.199827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:38.200304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:38.200725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:38.330277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:38.338938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5967c8ff-cf80-480a-80ab-dac5a6a4c95c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151635 Nov 02 03:52:38.339502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 971/1943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:38.360658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:38.361279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:38.367710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:38.368222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:38.368660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:38.369355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:38.369844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:38.370279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:38.432908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:38.440892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b1cf961c-c4ee-447e-b93e-836a9d34145f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084134 Nov 02 03:52:38.441522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 973/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:39.362451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:39.363071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:39.369442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:39.369901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:39.370336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:39.371015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:39.371461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:39.371878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:39.463105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:39.463894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:39.470208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:39.470626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:39.471057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:39.471751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:39.472227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:39.472646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:39.523533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:39.535339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-68ddf45b-f73b-4a8a-9fc2-8e95055128d2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.176618 Nov 02 03:52:39.535934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 972/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:39.541569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:39.549784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2086d6f4-e393-4235-a6ea-eecda255d867 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.091085 Nov 02 03:52:39.550352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 974/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:40.560278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:40.560892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:40.567284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:40.567770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:40.568242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:40.568939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:40.569399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:40.569823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:40.573903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:40.574520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:40.581965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:40.582676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:40.583115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:40.583880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:40.584292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:40.584774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:40.667975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:40.676127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4f2ddff9-12d1-436c-8e1f-e19cfc48a1cf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.106945 Nov 02 03:52:40.676690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 975/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:40.821451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:40.829598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b8e5e386-c9e5-4887-86c8-6f75a9319e0d tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.273288 Nov 02 03:52:40.830157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 973/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:41.699447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:41.700092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:41.706362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:41.706838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:41.707271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:41.707981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:41.708437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:41.708870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:41.771847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:41.780597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e1ddba54-f966-407d-9820-5d752747d15e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085485 Nov 02 03:52:41.781170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 976/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:41.852551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:41.853164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:41.859550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:41.860057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:41.860496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:41.861214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:41.861663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:41.862084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:41.987347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:41.995584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0c9977be-484f-48a2-b295-4e772a73e2e6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146941 Nov 02 03:52:41.996177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 974/1950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:41 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:42.802695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:42.803235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:42.809730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:42.810206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:42.810636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:42.811317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:42.811765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:42.812215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:42.871542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:42.879808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-925f8ec2-fbd0-47af-8090-89976d1cfaef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081084 Nov 02 03:52:42.880400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 977/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:43.018572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:43.019190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:43.026024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:43.026503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:43.026938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:43.027656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:43.028138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:43.028565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:43.156790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:43.164794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bd1ab6ba-e445-4098-aba7-f3196df3f0f4 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150125 Nov 02 03:52:43.165352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 975/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:43 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:43.902515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:43.903137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:43.909490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:43.909972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:43.910418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:43.911110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:43.911567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:43.912019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:43.972994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:43.981592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9541c589-ea49-41ae-9bc4-0c43e833bfaa tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082908 Nov 02 03:52:43.982152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 978/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:44.187451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:44.188064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:44.194562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:44.195048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:44.195490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:44.196215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:44.196701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:44.197123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:44.324210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:44.332449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc151775-0a6e-4c84-af33-a16ed341d269 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148921 Nov 02 03:52:44.333011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 976/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:44 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:45.006035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:45.006653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:45.013515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:45.013997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:45.014433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:45.015128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:45.015581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:45.016030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:45.082045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:45.090395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48c09b94-a92c-4155-92ec-f93276a2f281 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088683 Nov 02 03:52:45.090954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 979/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:45.356174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:45.356723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:45.363069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:45.363553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:45.364009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:45.364694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:45.365137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:45.365559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:45.492868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:45.501131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-85ae167b-b622-45e6-940e-6d0e8fec36c5 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149004 Nov 02 03:52:45.501690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 977/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:45 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:46.112648 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:46.113288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:46.119850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:46.120373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:46.120808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:46.121501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:46.121950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:46.122378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:46.183976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:46.192235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-35610c98-4eae-49d3-980a-cb884b12ec3c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083445 Nov 02 03:52:46.192823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 980/1957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:46.525676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:46.526444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:46.533012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:46.533499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:46.533935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:46.534637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:46.535085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:46.535505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:46.538321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:46.668043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:46.676243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5f7c559f-4c39-4072-8214-7417441d71a7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154976 Nov 02 03:52:46.676799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 978/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:46 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:47.214792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:47.215403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:47.221730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:47.222202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:47.222634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:47.223312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:47.223756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:47.224202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:47.284736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:47.293528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2669b43-acb6-467c-83ae-1e16cbb17558 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082668 Nov 02 03:52:47.294097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 981/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:47.699090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:47.699705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:47.706188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:47.706669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:47.707103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:47.707793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:47.708340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:47.708761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:47.833173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:47.841928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-550054f7-a1c1-4ef4-86b7-d55557ae7236 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147221 Nov 02 03:52:47.842487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 979/1960] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:47 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:48.316277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:48.316890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:48.323902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:48.324413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:48.324847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:48.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:48.325984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:48.326410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:48.390733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:48.398957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d4f79533-bfd4-4ec3-bb78-6fd1f3be0d97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086711 Nov 02 03:52:48.399511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 982/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:48.864609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:48.865251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:48.867565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:48.872907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:48.873327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:48.873765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:48.874453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:48.875175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:48.875598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:48.998910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:49.007235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5582c33c-d732-466d-8f09-e2ddedf21404 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146456 Nov 02 03:52:49.007800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 980/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:48 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:49.421505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:49.422044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:49.428427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:49.428903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:49.429336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:49.430658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:49.431115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:49.431539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:49.491504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:49.500514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6a8a0418-e5ce-4568-992d-b2a2eb555cb8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082972 Nov 02 03:52:49.501073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 983/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:50.029695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:50.030303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:50.036690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:50.037196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:50.037622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:50.038299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:50.038745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:50.039703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:50.175872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:50.179166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e41442a-43aa-4585-8f8f-6f593d0cfaed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153265 Nov 02 03:52:50.180423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 981/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:50 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:50.522554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:50.523169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:50.530131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:50.530605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:50.531035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:50.531718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:50.532189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:50.532614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:50.592618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:50.600725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4f1deabc-f856-4dac-ba96-e6f6e542610c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082073 Nov 02 03:52:50.601285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 984/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:51.202734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:51.203294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:51.209666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:51.210151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:51.210592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:51.211316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:51.211769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:51.212231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:51.338542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:51.347778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b3ab83b1-4040-40f5-9ca5-a398817d930a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148973 Nov 02 03:52:51.348396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 982/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:51 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:51.623753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:51.624692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:51.631258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:51.631734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:51.632200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:51.632907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:51.633354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:51.633776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:51.647828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:51.701695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:51.709752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c661a95b-1e41-47ab-b8a1-6f78ae8f833d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.089879 Nov 02 03:52:51.710308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 985/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:52.370581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:52.371197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:52.378258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:52.378797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:52.379237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:52.379985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:52.380410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:52.380828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:52.510690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:52.518899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-16c4b304-3a58-4e86-a8df-ef15cf4bf729 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152225 Nov 02 03:52:52.519453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 983/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:52 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:52.732208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:52.732824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:52.739263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:52.739739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:52.740209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:52.740909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:52.741356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:52.741779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:52.802155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:52.810805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5fb1bafc-b292-4071-ad66-ce90c2e2fe52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082596 Nov 02 03:52:52.811368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 986/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:53.542527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:53.543149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:53.549553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:53.550036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:53.550476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:53.551192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:53.551645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:53.552101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:53.681483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:53.689678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3c0f22e5-857e-42ee-8c2c-fce3ab8a3754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.151005 Nov 02 03:52:53.690234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 984/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:53 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:53.833922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:53.834470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:53.840921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:53.841401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:53.841840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:53.842539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:53.842993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:53.843421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:53.904306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:53.912492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1ab08426-2e34-4756-a09b-fb7a21ee4b1b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082634 Nov 02 03:52:53.913047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 987/1971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:54.713019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:54.713631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:54.719645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:54.720156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:54.720587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:54.721263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:54.721707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:54.722126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:54.845179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:54.853218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad122955-aabc-4ac9-af70-1bd8551d30b6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144637 Nov 02 03:52:54.853770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 985/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:54 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:54.935909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:54.936544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:54.942825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:54.943297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:54.943728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:54.944439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:54.944886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:54.945863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:55.008990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:55.017141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3dc27f24-cac3-4810-a954-fd1de9510a43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085097 Nov 02 03:52:55.017696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 988/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:55.875740 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:55.876390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:55.883211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:55.883689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:55.884153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:55.884845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:55.885298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:55.885721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:56.016271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:56.025706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b6f968ca-f39f-4d4a-bdc5-826d1fe07079 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154000 Nov 02 03:52:56.026262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 986/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:55 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:56.040779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:56.041644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:56.048411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:56.048899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:56.049341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:56.050038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:56.050622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:56.051081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:56.112204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:56.120482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f0d3acb1-dad1-4608-a847-965150fde52e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083826 Nov 02 03:52:56.121027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 989/1975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:57.047861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:57.048519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:57.055355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:57.055830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:57.056296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:57.056997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:57.057437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:57.057856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:57.143999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:57.144698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:57.151132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:57.151698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:57.152259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:57.153026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:57.153556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:57.154078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:57.187918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:57.196923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3dc7140d-e45c-4fa7-8b6c-dbc848a0d500 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152879 Nov 02 03:52:57.197501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 987/1976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:57 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:57.215749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:57.223832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1ae84d64-2471-4e18-8b61-9cba88acba9e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083661 Nov 02 03:52:57.224415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 990/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:58.219976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:58.220591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:58.226998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:58.227495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:58.227912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:58.228626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:58.229073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:58.229495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:58.246048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:58.246664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:58.249114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=56 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:52:58.254521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:58.255003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:58.255442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:58.256164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:58.256716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:58.257148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:58.329507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:58.338342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-76e4a286-863d-4013-b901-2c95c8cfa195 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.096115 Nov 02 03:52:58.338910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 991/1978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:52:58.384370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:58.392534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8eebc241-2108-45dc-acd5-5d789a298f64 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.176477 Nov 02 03:52:58.393099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 988/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:58 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:59.360892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:59.361508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:59.367894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:59.368399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:59.368834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:59.369530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:59.369959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:59.370379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:59.416722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:52:59.417336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:52:59.423765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:59.424275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:59.424712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:59.425405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:52:59.425856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:52:59.426281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:52:59.430480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:59.438684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-341d9e70-2c4a-43dd-ad58-e9bca2ec8165 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081610 Nov 02 03:52:59.439448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 992/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:52:59.554637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:52:59.562882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dc492374-fe57-47ab-86a5-f7850fe70200 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150752 Nov 02 03:52:59.563456 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 989/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:52:59 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:00.461288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:00.461900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:00.468292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:00.468773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:00.469208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:00.469897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:00.470348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:00.470770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:00.533597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:00.542444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-afd66bab-25d1-4c8c-9821-2720e434b1b3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085016 Nov 02 03:53:00.542999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 993/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:00.585667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:00.586271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:00.592686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:00.593155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:00.593583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:00.594258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:00.594703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:00.595121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:00.718327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:00.726450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-61ce1ea0-06b0-42d9-bede-997238d70e65 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144613 Nov 02 03:53:00.727506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 990/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:00 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:01.564831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:01.565439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:01.572433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:01.572931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:01.573365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:01.574043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:01.574492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:01.574910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:01.635344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:01.643436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-800a65da-2f0c-45d9-9147-53c410e5d837 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082474 Nov 02 03:53:01.644009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 994/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:01.752102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:01.752726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:01.759674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:01.760186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:01.760628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:01.761320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:01.761774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:01.762203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:01.890149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:01.898273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-96a188b2-a3c2-4399-b840-6dc65f11dc7b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150324 Nov 02 03:53:01.899056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 991/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:01 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:02.665886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:02.666500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:02.672786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:02.673260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:02.673692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:02.674373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:02.674818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:02.675237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:02.735145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:02.743212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8fc1a648-b8e3-4f46-905a-5ec2be16af76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081226 Nov 02 03:53:02.743768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 995/1986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:02.921212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:02.921856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:02.928471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:02.928956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:02.929392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:02.930082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:02.930533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:02.930955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:03.054777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:03.063363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c6881317-c3fb-4b84-909d-cfb2b047b616 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146099 Nov 02 03:53:03.063919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 992/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:02 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:03.766518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:03.767132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:03.773543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:03.774522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:03.774954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:03.775646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:03.776138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:03.776561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:03.839252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:03.847331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1692c8f4-99ba-4522-a732-5ccbdc1a8252 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084682 Nov 02 03:53:03.847889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 996/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:04.087080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:04.087626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:04.094008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:04.094484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:04.094922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:04.095607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:04.096086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:04.096513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:04.220936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:04.229041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4da33b65-7bee-41f5-8bfb-4f2115fd7c41 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146398 Nov 02 03:53:04.229603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 993/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:04 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:04.871003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:04.871554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:04.878175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:04.878710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:04.879182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:04.879873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:04.880356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:04.880781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:04.944090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:04.952111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-df65a13c-f985-44b0-952a-59e5b70cbe59 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085448 Nov 02 03:53:04.952658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 997/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:05.251852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:05.252562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:05.258904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:05.259381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:05.259815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:05.260527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:05.260975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:05.261409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:05.387402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:05.389705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:05.396894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c45a6404-488e-4107-a4dc-5f84dc9a176e tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149110 Nov 02 03:53:05.397454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 994/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:05 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:05.974592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:05.975210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:05.981650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:05.982129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:05.982568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:05.983257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:05.983716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:05.984166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:06.044468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:06.052743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fdae0d3c-e3cd-4fd6-acb8-68c8209b879b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081977 Nov 02 03:53:06.053303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 998/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:06.420834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:06.421370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:06.429133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:06.429608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:06.430057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:06.431329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:06.431775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:06.432215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:06.559075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:06.567373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-11e02b68-f03f-4c1b-ae5d-f37587f44875 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150445 Nov 02 03:53:06.567933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 995/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:06 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:07.075427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:07.076056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:07.082420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:07.082899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:07.083333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:07.084055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:07.084508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:07.084934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:07.148258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:07.156946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6555e6a1-fcfe-49ee-af7d-fc35d47dc10b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085526 Nov 02 03:53:07.157511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 999/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:07.590132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:07.590744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:07.597180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:07.597656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:07.598091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:07.598776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:07.599225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:07.599647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:07.725792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:07.733927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-147fad88-94b9-45bd-a9cf-c35a8326baed tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147665 Nov 02 03:53:07.734486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 996/1995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:07 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:08.179245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:08.179865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:08.186883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:08.187363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:08.187805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:08.188530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:08.188986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:08.189413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:08.248985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:08.257449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8e4b75e8-f25a-41f2-8668-bfb716d95b20 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082076 Nov 02 03:53:08.258006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1000/1996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:08.757311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:08.757923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:08.764947 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:08.765422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:08.765884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:08.766565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:08.767019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:08.767440 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:08.895153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:08.903944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d3d7a761-a24f-48a6-bdd8-8bf55e6550c1 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150520 Nov 02 03:53:08.905145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 997/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:08 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:09.279939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:09.280589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:09.287016 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:09.287516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:09.287985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:09.288668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:09.289123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:09.289552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:09.349600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:09.358289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-36c2a279-dd1a-4fb4-bd3d-f59a01fbdb34 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082200 Nov 02 03:53:09.358848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1001/1998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:09.926891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:09.927459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:09.933857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:09.934331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:09.934768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:09.935452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:09.935899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:09.936340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:10.060775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:10.068938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f4f28dd-7975-473b-8b26-45db7443c817 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145986 Nov 02 03:53:10.069496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 998/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:09 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:10.381750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:10.382373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:10.389364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:10.389845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:10.390286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:10.390973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:10.391426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:10.391857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:10.394454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:10.454988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:10.463842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f2b4db18-0634-4f5f-8e7f-133987baa37f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085268 Nov 02 03:53:10.464432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1002/2000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:11.092116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:11.092729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:11.099062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:11.099533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:11.100132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:11.100664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:11.101113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:11.101555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:11.226513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:11.235255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-201dd8e8-99f6-4210-9bd8-faf56bc14a9a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147090 Nov 02 03:53:11.235808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 999/2001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:11 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:11.486020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:11.486644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:11.493099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:11.493584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:11.494021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:11.494753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:11.495207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:11.495638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:11.560995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:11.569115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d3bcae16-f64a-4835-a0e9-c147c5b1fed0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086994 Nov 02 03:53:11.569672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1003/2002] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:12.258098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:12.258719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:12.265764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:12.266242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:12.266680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:12.267368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:12.267821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:12.268270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:12.395666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:12.403806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a239318d-c29c-45d0-9824-e64071f9c25c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149578 Nov 02 03:53:12.404417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1000/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:12 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:12.592298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:12.592918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:12.599419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:12.599840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:12.600308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:12.601000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:12.601453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:12.601881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:12.661651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:12.670252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e800a379-7dd0-496f-81de-234c8c28a13f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081786 Nov 02 03:53:12.670809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1004/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:13.426692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:13.427306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:13.433862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:13.434333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:13.434764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:13.435447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:13.435899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:13.436345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:13.562268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:13.570806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d4059cb2-f721-47fe-8464-bb3d1b993566 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148019 Nov 02 03:53:13.571374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1001/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:13 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:13.693555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:13.694109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:13.701077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:13.701562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:13.702005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:13.702699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:13.703159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:13.703585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:13.768168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:13.776320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7a596c5b-a269-4210-b323-bfd12daf51b0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086618 Nov 02 03:53:13.776886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1005/2006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:14.594698 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:14.595339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:14.601766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:14.602240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:14.602674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:14.603361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:14.603807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:14.604281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:14.730730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:14.738776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9026fb57-3e7d-46ef-b2cb-18b2b5d4c28b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147933 Nov 02 03:53:14.739339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1002/2007] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:14 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:14.798575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:14.799095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:14.805530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:14.806002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:14.806432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:14.807757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:14.808254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:14.808660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:14.867750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:14.876675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-007645f4-065b-40cf-be1c-003d46ca8f09 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081976 Nov 02 03:53:14.877232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1006/2008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:15.763027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:15.763641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:15.770035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:15.770517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:15.770955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:15.771650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:15.772207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:15.772638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:15.899204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:15.899736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:15.899869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:15.906306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:15.906787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:15.907225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:15.907975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:15.908438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:15.908557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9706faab-e062-4a30-ad67-611cdb3b29fb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.149835 Nov 02 03:53:15.908865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:15.909234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1003/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:15 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:15.969342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:15.977436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2a55dc6a-1f59-447b-aa0e-0b5778556803 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082072 Nov 02 03:53:15.977998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1007/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:16.931612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:16.932258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:16.938725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:16.939207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:16.939677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:16.940400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:16.940854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:16.941281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:17.000225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:17.000857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:17.007121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:17.007596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:17.008062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:17.008749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:17.009207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:17.009612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:17.086446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:17.094061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:17.095244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-50f2d8bb-2610-46b0-8d9b-96708c0bf607 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.099170 Nov 02 03:53:17.095807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1008/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:17.102247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7caab45c-7bd0-472a-af30-501b9370dc48 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.174436 Nov 02 03:53:17.102813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1004/2012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:16 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:18.117597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:18.118208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:18.124191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:18.125073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:18.125215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:18.125612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:18.126042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:18.126732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:18.127185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:18.127605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:18.131448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:18.131924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:18.132395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:18.133079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:18.133530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:18.133951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:18.211685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:18.220445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d134da1d-f5f8-4b42-bf08-a1a501f419fd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.106645 Nov 02 03:53:18.221023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1009/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:18.277268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:18.285309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-40de0213-5044-41f8-a5d1-2a2520668b72 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.165017 Nov 02 03:53:18.285867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1005/2014] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:18 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:19.243724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:19.244981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:19.251816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:19.252326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:19.252763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:19.253452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:19.253904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:19.254330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:19.308835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:19.309417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:19.311751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=52 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:19.315239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:19.317161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:19.317643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:19.318079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:19.318774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:19.319226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:19.319650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:19.323438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ecf3ffb5-46bf-4348-ae8b-6c2401d68f05 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083541 Nov 02 03:53:19.324260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1010/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:19.448474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:19.456535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5cd30049-2c15-44f8-aefe-6204628a9d3a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.152385 Nov 02 03:53:19.457090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1006/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:19 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:20.346315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:20.346934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:20.353468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:20.353945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:20.354379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:20.355065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:20.355516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:20.355938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:20.416054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:20.424227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a175cae0-d0e8-46a3-88c4-0f09cd53ed8c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081817 Nov 02 03:53:20.424787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1011/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:20.479798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:20.480443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:20.486790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:20.487257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:20.487682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:20.488391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:20.488834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:20.489249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:20.614872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:20.623542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7e55b7d6-a71b-4874-adf9-7347087f39f7 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147588 Nov 02 03:53:20.624125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1007/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:20 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:21.446538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:21.447202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:21.453576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:21.454054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:21.454483 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:21.455157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:21.455603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:21.456050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:21.519786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:21.528191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b3348b1-f6d8-436a-9217-f665d586c25d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085457 Nov 02 03:53:21.528913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1012/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:21.645371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:21.645906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:21.652435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:21.652906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:21.653337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:21.654043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:21.654489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:21.654904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:21.779315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:21.787343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-845209a2-4777-4822-b3b0-cebf5664bf12 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145890 Nov 02 03:53:21.787899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1008/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:21 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:22.550592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:22.551209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:22.557714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:22.558195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:22.558629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:22.559315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:22.559764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:22.560214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:22.620467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:22.628801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84fc2c14-9ccb-406b-a8ff-cfa75f523f68 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082079 Nov 02 03:53:22.629358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1013/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:22.810656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:22.811190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:22.817492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:22.817960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:22.818390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:22.819068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:22.819511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:22.819927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:22.952036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:22.960066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e8ca1e3-fa25-450f-baf5-39bc99ba8854 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153369 Nov 02 03:53:22.960626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1009/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:22 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:23.651294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:23.651905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:23.658531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:23.659041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:23.659476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:23.660195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:23.660674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:23.661095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:23.720762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:23.729259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cc1cc069-987a-4281-aaf8-be5e63b29b13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081811 Nov 02 03:53:23.729808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1014/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:23.983841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:23.984486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:23.990664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:23.991137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:23.991571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:23.992287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:23.992735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:23.993158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:24.116598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:24.124716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3a2d98e9-a488-40ba-96b9-9c894d63098a tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.144670 Nov 02 03:53:24.125538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1010/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:23 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:24.752577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:24.753191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:24.760087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:24.760579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:24.761012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:24.761692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:24.762141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:24.762593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:24.827516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:24.835626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6a82f241-12fa-414f-80ae-114d17837b4a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087216 Nov 02 03:53:24.836208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1015/2025] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:25.147904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:25.148475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:25.154857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:25.155337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:25.155786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:25.156498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:25.156955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:25.157378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:25.172419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:25.283965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:25.292729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3b297d4b-3556-47ce-8a77-a54aceab1046 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.148756 Nov 02 03:53:25.293293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1011/2026] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:25 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:25.858717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:25.859234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:25.865576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:25.866049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:25.866479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:25.867152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:25.867598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:25.868042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:25.928086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:25.936130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b0f49228-f3e0-427a-9388-bbd811d65372 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081296 Nov 02 03:53:25.936685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1016/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:26.316222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:26.316843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:26.323662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:26.324184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:26.324619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:26.325304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:26.325759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:26.326181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:26.456163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:26.466685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-49761530-a961-4f19-afa0-ba2615a20bd2 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.154306 Nov 02 03:53:26.467285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1012/2028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:26 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:26.958776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:26.959330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:26.965770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:26.966250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:26.966688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:26.967377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:26.967830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:26.968286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:27.029448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:27.037475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-faf7c152-0a3a-4ed1-936d-9146a72a7117 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082671 Nov 02 03:53:27.038033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1017/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:27.489647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:27.490280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:27.496701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:27.497175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:27.497609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:27.498294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:27.498742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:27.499166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:27.622820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:27.631237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4069b40e-cc1d-4fb8-b145-e247e4310311 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145437 Nov 02 03:53:27.631831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1013/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:27 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:28.060919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:28.061536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:28.067614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:28.068119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:28.068554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:28.069263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:28.069710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:28.070128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:28.133012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:28.135782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:28.142700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-66746704-8e1d-40f5-ba98-a308a21512c9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085615 Nov 02 03:53:28.143257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1018/2031] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:28.654128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:28.654777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:28.661133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:28.661611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:28.662047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:28.662726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:28.663177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:28.663598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:28.787368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:28.796023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de26e04b-fba4-4734-8a81-fea444344c6b tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145734 Nov 02 03:53:28.796587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1014/2032] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:28 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:29.164956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:29.165488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:29.168337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=56 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:29.173468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:29.173947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:29.174377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:29.175067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:29.175510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:29.175927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:29.236269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:29.244500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-73ec9c67-859c-42e9-a2ea-ad3e68821515 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083726 Nov 02 03:53:29.245058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1019/2033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:29.819431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:29.819989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:29.827078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:29.827533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:29.827986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:29.828675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:29.829124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:29.829546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:30.159282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:30.167883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-44d15e1f-ee9a-4494-a029-765eb11f5bfb tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.352407 Nov 02 03:53:30.168466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1015/2034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:29 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:30.267962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:30.268579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:30.275022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:30.275494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:30.275926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:30.276625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:30.277071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:30.277489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:30.338267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:30.346269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-315b7066-1445-497b-b714-45cb8a106688 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082104 Nov 02 03:53:30.346822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1020/2035] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:31.191274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:31.191834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:31.198870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:31.199346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:31.199774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:31.200491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:31.200941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:31.201363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:31.329706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:31.338009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ded9d6d7-0bb7-4e97-9759-4c22d2acd754 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150477 Nov 02 03:53:31.338576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1016/2036] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:31 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:31.369675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:31.370338 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:31.376969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:31.377451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:31.377895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:31.378584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:31.379036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:31.379460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:31.440819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:31.449621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-994108e9-78f7-41ee-b539-04a2879ca53b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084275 Nov 02 03:53:31.450121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1021/2037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:32.360761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:32.361302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:32.367757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:32.368268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:32.368705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:32.369420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:32.369871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:32.370295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:32.471660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:32.472335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:32.478655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:32.479133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:32.479568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:32.480315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:32.481138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:32.481262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:32.494730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:32.503069 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b5d0aefb-4029-48b2-9591-b0b2f40bc0a6 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.146196 Nov 02 03:53:32.503631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1017/2038] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:32 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:32.545580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:32.553796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-30847b19-2c21-4371-b263-31d9352fdb06 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085983 Nov 02 03:53:32.554331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1022/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:33.527116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:33.527730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:33.534101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:33.534577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:33.535007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:33.535690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:33.536160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:33.536579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:33.576081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:33.576689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:33.582988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:33.583463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:33.583895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:33.584619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:33.585093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:33.585513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:33.655691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:33.663761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-32379387-8605-4985-8c76-28105b62e65d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.091458 Nov 02 03:53:33.664347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1023/2040] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:33.684356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:33.692477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-22e85bdc-6ed7-495c-825e-01e27b6167be tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.169739 Nov 02 03:53:33.693037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1018/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:33 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:34.687836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:34.688489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:34.694913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:34.695422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:34.695857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:34.696569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:34.697022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:34.697447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:34.715296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:34.715938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:34.722543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:34.723019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:34.723448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:34.724155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:34.724599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:34.725013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:34.758399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:34.767772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e02c6833-e1f2-4922-a5a5-ccf1211f79a6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082875 Nov 02 03:53:34.767772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1024/2042] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:34.853721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:34.861744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d73e4bfe-4b6c-4331-8d4f-39a1176edad3 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150219 Nov 02 03:53:34.862301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1019/2043] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:34 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:53:35.789249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:35.789782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:35.796236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:35.796709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:35.797136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:35.797814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:35.798261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:35.798681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:35.858189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:35.866112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1a07bd48-eba3-4279-aad0-aadb9667d2b1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080763 Nov 02 03:53:35.866660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1025/2044] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:35.885264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:35.885873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:35.892146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:35.892615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:35.893040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:35.893716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:35.894156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:35.894571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:36.017384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:36.026064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-472d4db7-d66a-46e6-b2ea-1d8a087c9348 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.145236 Nov 02 03:53:36.026619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1020/2045] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:35 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:36.889951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:36.890514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:36.896851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:36.897325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:36.897762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:36.898448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:36.898898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:36.899321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:36.962051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:36.970706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cb58b898-167d-44a7-8215-2a7a52cdff3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084666 Nov 02 03:53:36.971268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1026/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:37.048424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:37.049036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:37.055621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:37.056139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:37.056572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:37.057249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:37.057693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:37.058134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:37.186856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:37.195038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e9874503-62bb-446b-a26f-56060f79837c tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.150434 Nov 02 03:53:37.195603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1021/2047] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:37 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:37.992403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:37.993027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:38.000302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:38.000787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:38.001229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:38.001924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:38.002382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:38.002812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:38.062460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:38.070568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e8f61f58-0520-479d-80c0-ce2a0d88a902 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082071 Nov 02 03:53:38.071131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1027/2048] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:38.217854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:38.218450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:38.224827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:38.225298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:38.225724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:38.226404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:38.226848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:38.227263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:38.359443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:38.367673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c502f15-3d0b-4234-a322-0ceecc3e4c34 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153620 Nov 02 03:53:38.368254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1022/2049] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:38 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:39.093885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:39.094504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:39.100880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:39.101388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:39.101831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:39.102531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:39.102983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:39.103409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:39.163312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:39.171891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e0f491e8-1710-4b2b-bca0-4ff119de8706 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081868 Nov 02 03:53:39.172615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1028/2050] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:39.391179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:39.391704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:39.397978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:39.398448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:39.398876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:39.399549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:39.400590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:39.401012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:39.526222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:39.534419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8436a10f-c577-4b10-b591-7108cdce6889 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.147125 Nov 02 03:53:39.534980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1023/2051] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:39 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:40.194342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:40.194955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:40.202301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:40.202820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:40.203259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:40.204095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:40.204563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:40.204993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:40.269983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:40.278482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1fc81e11-85a5-4728-a0d4-da8beba21262 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088054 Nov 02 03:53:40.279040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1029/2052] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:40.558938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:40.559575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] [instance: 3cb081e9-a274-4ed2-850c-750041b05e81] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:40.566015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:40.566487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:40.566919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:40.567688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:40.568155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:40.568573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:40.698794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6abf03a1cb4ecaa8b2edfb8a576418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909fcdad3cef45ad9cf5494524d2b354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:40.708035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3975197c-3d0d-4dbb-9f59-f2fc5ce066a0 tempest-VolumesSnapshotTestJSON-903728868 tempest-VolumesSnapshotTestJSON-903728868-project] 10.222.0.26 "GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81" status: 200 len: 1559 microversion: 2.1 time: 0.153775 Nov 02 03:53:40.708607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1024/2053] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:40 2022] GET /compute/v2.1/servers/3cb081e9-a274-4ed2-850c-750041b05e81 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:41.301360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:41.302000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:41.308450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:41.308929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:41.309360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:41.310045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:41.310493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:41.310911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:41.370709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:41.379078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a117776b-1bf5-4b2d-8256-eb1ddb0ecbbd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081585 Nov 02 03:53:41.379638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1030/2054] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:41 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:42.497968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:42.498586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:42.504966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:42.505449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:42.505930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:42.506605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:42.507063 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:42.507492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:42.571218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:42.579332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-91d26194-94a7-49ba-9b75-d568e239d526 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.181163 Nov 02 03:53:42.579886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1025/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:43.603911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:43.604580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:43.610969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:43.611447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:43.611883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:43.612591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:43.613041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:43.613473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:43.673057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:43.681102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1b9e6656-051e-4aed-8cf1-b48a1a8dcb76 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081095 Nov 02 03:53:43.681662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1031/2056] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:44.703524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:44.704251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:44.710690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:44.711173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:44.711612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:44.712838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:44.713292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:44.713718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:44.773484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:44.782124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-141c98c9-4cf0-4881-a3d1-9fd6b2455c96 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082410 Nov 02 03:53:44.782633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1026/2057] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:45.805394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:45.806618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:45.813523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:45.813999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:45.814431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:45.815115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:45.815565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:45.816024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:45.876275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:45.884220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-98b0e475-114f-4df0-ab76-64c8813ad467 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082734 Nov 02 03:53:45.884777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1032/2058] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:46.906781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:46.907315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:46.913719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:46.914189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:46.914616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:46.915297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:46.915743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:46.916190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:46.975754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:46.983843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ea373e87-8ef8-40f4-a470-748d394956d1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080983 Nov 02 03:53:46.984424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1027/2059] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:48.006629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:48.007266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:48.013688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:48.014169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:48.014602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:48.015281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:48.015728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:48.016181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:48.078114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:48.086241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1eaa6a81-48b7-4ef3-a5ec-085b4003d2c0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083473 Nov 02 03:53:48.086792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1033/2060] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:49.109443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:49.110052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:49.116493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:49.116967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:49.117398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:49.118077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:49.118520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:49.118938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:49.121443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:49.180594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:49.188989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f58fbbde-ae34-4e3d-b7f2-5c5757990b11 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083419 Nov 02 03:53:49.189553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1028/2061] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:50.210658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:50.211266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:50.213292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:53:50.213454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:53:50.222989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:50.223490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:50.223901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:50.224642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:50.225115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:50.225537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:50.286579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:50.295022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6a46ab55-6fe3-42fa-a1ec-fd0330342b4c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088287 Nov 02 03:53:50.295580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1034/2062] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:51.317899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:51.318513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:51.321075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:53:51.321206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:53:51.322604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=46 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:51.329052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:51.329531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:51.329974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:51.330667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:51.331115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:51.331538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:51.399116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:51.407660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b4fc6c43-492b-465e-bf36-e59b2a406b7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.093588 Nov 02 03:53:51.408274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1029/2063] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:51 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:52.430589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:52.431229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:52.437633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:52.438115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:52.438551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:52.439246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:52.439698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:52.440154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:52.455045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=100 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:52.504384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:52.513013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-458ec839-c015-4413-81f3-71116b672b8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086299 Nov 02 03:53:52.513578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1035/2064] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:53.535958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:53.536610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:53.543704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:53.544201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:53.544635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:53.545321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:53.545767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:53.546191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:53.606704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:53.614804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3612a6b5-d48f-4ddf-81e1-c0b5127a5516 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082710 Nov 02 03:53:53.615371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1030/2065] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:54.638367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:54.639021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:54.645499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:54.645983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:54.646423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:54.647144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:54.648780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:54.649227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:54.709808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:54.717813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c40d5762-2c44-45f3-a70b-567b3a8c9a6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084011 Nov 02 03:53:54.718365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1036/2066] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:55.740933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:55.741556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:55.747535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:55.748045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:55.748490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:55.749177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:55.749630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:55.750327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:55.813828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:55.822559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6e593150-80c5-4103-bc0a-e1970b84d87d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085703 Nov 02 03:53:55.823124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1031/2067] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:56.844810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:56.845422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:56.852087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:56.852563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:56.852996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:56.854353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:56.854800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:56.855221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:56.919332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:56.927442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-87d35255-216b-4243-b002-1f7fcb013abb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086435 Nov 02 03:53:56.928010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1037/2068] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:57.949817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:57.950433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:57.956885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:57.957362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:57.957793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:57.958479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:57.958928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:57.959347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:58.018944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:58.027040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d298fe4d-1eae-4afa-b605-aa86951499a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081110 Nov 02 03:53:58.027604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1032/2069] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:53:59.049528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:53:59.050147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:53:59.056245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:59.056781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:59.057216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:59.057893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:53:59.058342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:53:59.058760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:53:59.118346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:53:59.126649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-42ec010d-7ea1-4a62-8542-c640480b3af5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080968 Nov 02 03:53:59.127211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1038/2070] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:53:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:00.149201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:00.149821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:00.156199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:00.156679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:00.157112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:00.157794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:00.158241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:00.158663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:00.218638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:00.226722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-11400482-4ddb-4a4c-9fe6-be9e101a0fef tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081367 Nov 02 03:54:00.227279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1033/2071] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:01.249215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:01.250110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:01.252527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=40 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:01.257654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:01.258131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:01.258570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:01.259252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:01.259703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:01.260658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:01.323889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:01.332056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-00cef52e-20f9-4d21-a8c3-e153763f768c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086744 Nov 02 03:54:01.332613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1039/2072] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:02.354609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:02.355212 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:02.361596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:02.362072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:02.362507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:02.363197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:02.363646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:02.364103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:02.424219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:02.432312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3e82f0b2-119a-4fe3-9904-3848c213a2e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081613 Nov 02 03:54:02.432880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1034/2073] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:02 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:03.456145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:03.456756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:03.463548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:03.464046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:03.464478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:03.465149 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:03.465593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:03.466010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:03.527704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:03.535864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-01352f4a-9fa7-4e15-96f1-3034f8cad585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083578 Nov 02 03:54:03.536517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1040/2074] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:04.559233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:04.559850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:04.566305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:04.566779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:04.567214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:04.567906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:04.568387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:04.568814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:04.628830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:04.636945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf90604c-d3ef-4158-a90a-4497f27c57d4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082245 Nov 02 03:54:04.637502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1035/2075] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:05.659522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:05.660165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:05.667047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:05.667520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:05.667964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:05.668647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:05.669093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:05.669510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:05.732361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:05.740476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2b948ab-79a5-4890-8ab5-8a383beb7570 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084903 Nov 02 03:54:05.741039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1041/2076] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:06.762777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:06.763391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:06.770013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:06.770495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:06.770927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:06.771606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:06.772077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:06.772501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:06.835522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:06.843621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf6e50de-0746-422f-b154-6053f0182387 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084713 Nov 02 03:54:06.844293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1036/2077] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:07.866642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:07.867206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:07.874174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:07.874652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:07.875342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:07.876054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:07.876497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:07.876917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:07.936446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:07.944441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-44908585-4ab1-4de1-a229-f7be3e9f324c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081764 Nov 02 03:54:07.944994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1042/2078] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:08.969900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:08.970514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:08.976949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:08.977419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:08.977849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:08.979140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:08.979584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:08.980025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:09.040450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:09.048415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-13fde872-4f2b-4c6a-ad57-6055ebe51873 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082286 Nov 02 03:54:09.048981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1037/2079] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:10.070451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:10.071064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:10.073034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:54:10.073175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:54:10.079789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:10.080281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:10.080708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:10.081388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:10.081833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:10.082252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:10.145229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:10.153916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c85287cd-40bf-485b-be15-a31183f31742 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087273 Nov 02 03:54:10.154481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1043/2080] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:11.176605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:11.177219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:11.184488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:11.184965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:11.185423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:11.186099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:11.186542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:11.186960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:11.247648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:11.256025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6b72d227-12ad-4be2-af30-11570c8a6b08 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083252 Nov 02 03:54:11.256578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1038/2081] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:11 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:12.279062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:12.279671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:12.286210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:12.286685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:12.287116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:12.287791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:12.288275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:12.288698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:12.351055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:12.359202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a8d4cca4-cdbe-4191-91ac-6f2fb525be6e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084575 Nov 02 03:54:12.359771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1044/2082] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:13.382045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:13.382695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:13.389096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:13.389562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:13.389988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:13.390659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:13.391101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:13.391519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:13.451123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:13.459447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c6bfefe-816a-42dc-9d8e-b0ab9d283fee tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081213 Nov 02 03:54:13.460045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1039/2083] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:14.482574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:14.483209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:14.489598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:14.490074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:14.490506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:14.491187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:14.491636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:14.492085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:14.555764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:14.564555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2f3bf23-1c4c-4e91-a7df-d1b961c96807 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086275 Nov 02 03:54:14.565103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1045/2084] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:15.587074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:15.587718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:15.594177 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:15.594680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:15.595113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:15.595800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:15.596279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:15.596703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:15.657046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:15.665184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0336d06e-0b19-4cab-b6e7-0765a47c1f13 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081933 Nov 02 03:54:15.665764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1040/2085] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:16.688080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:16.688694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:16.695092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:16.695567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:16.696025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:16.696713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:16.697668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:16.698091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:16.757863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:16.766744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-93aab271-d1a4-4e0b-9b95-fb3e6ab7d925 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082719 Nov 02 03:54:16.767302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1046/2086] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:17.789958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:17.790515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:17.796962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:17.797435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:17.797868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:17.798549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:17.798996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:17.799416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:17.859637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:17.867763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2576874b-6f08-4633-a431-31aba7316695 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081735 Nov 02 03:54:17.868360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1041/2087] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:18.893809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:18.894341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:18.901434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:18.901910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:18.902340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:18.903014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:18.903461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:18.903883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:18.966217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:18.974219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9f696af5-cab2-4e7b-814d-b3411ff85914 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084387 Nov 02 03:54:18.974773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1047/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:19.996774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:19.997388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:20.003996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:20.004468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:20.004899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:20.005573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:20.006016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:20.006428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:20.008934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:20.069007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:20.077068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4dd58380-3fbf-4f0c-a931-600ab5ffd2bb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084208 Nov 02 03:54:20.077615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1042/2089] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:21.100264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:21.100877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:21.107258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:21.107731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:21.108200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:21.108881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:21.109327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:21.109745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:21.169795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:21.177846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67831904-5514-4fd4-991c-11c66de6a740 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081557 Nov 02 03:54:21.178407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1048/2090] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:22.200023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:22.200634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:22.202905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:22.208053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:22.208523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:22.208960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:22.209634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:22.210072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:22.210487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:22.270584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:22.279215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fb701fd4-fe31-46b6-b124-ebd6ec83aa33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083124 Nov 02 03:54:22.279761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1043/2091] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:22 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:23.302352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:23.302992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:23.309691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:23.310166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:23.310594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:23.311274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:23.311723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:23.312181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:23.314650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=82 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:23.428345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:23.436500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af8e3609-d430-49b7-8a7a-1cda6fdfffc0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.137974 Nov 02 03:54:23.437048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1049/2092] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:24.459339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:24.459977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:24.466701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:24.467121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:24.467558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:24.468272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:24.468727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:24.469158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:24.530355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:24.538676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7da8f199-d392-4300-8f7f-b0abe6f20c19 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083185 Nov 02 03:54:24.539241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1044/2093] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:25.563152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:25.563765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:25.570202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:25.570679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:25.571114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:25.571795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:25.572270 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:25.572704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:25.635082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:25.643126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d69e34a3-500b-41c7-afbb-d4350245cc55 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083908 Nov 02 03:54:25.643682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1050/2094] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:26.666197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:26.666810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:26.673250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:26.673726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:26.674159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:26.674847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:26.675295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:26.675717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:26.735525 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:26.743690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3c64596f-8e88-492e-aa93-3cc9c9229b50 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081998 Nov 02 03:54:26.744285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1045/2095] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:27.766466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:27.767089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:27.773215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:27.773702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:27.774135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:27.774845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:27.775297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:27.775721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:27.837816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:27.845903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71e9d597-f169-4d27-bb13-54a42bfe24e9 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083329 Nov 02 03:54:27.846462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1051/2096] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:28.869901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:28.870447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:28.877043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:28.877514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:28.877946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:28.878876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:28.879327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:28.879751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:28.939434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:28.948154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-85b14fc8-a220-47c2-8ba0-728a9ab4384c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082965 Nov 02 03:54:28.948711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1046/2097] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:29.971516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:29.972158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:29.979082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:29.979558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:29.980184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:29.980866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:29.981318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:29.981736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:30.042326 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:30.050569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d64518eb-743d-4e6f-9b18-58023773fda1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082898 Nov 02 03:54:30.051123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1052/2098] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:31.073146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:31.073754 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:31.080092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:31.080561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:31.080990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:31.081663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:31.082113 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:31.082528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:31.142539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:31.151105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bb084854-07b5-42bd-a0b7-1769d28cd478 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081840 Nov 02 03:54:31.151662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1047/2099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:54:32.173872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:32.174496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:32.176798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:32.182353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:32.182831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:32.183262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:32.183939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:32.184419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:32.184838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:32.247816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:32.256162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a2ca5349-7337-4e68-9ad6-ac03e6440a2e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086147 Nov 02 03:54:32.256718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1053/2100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:33.278905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:33.279610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:33.285918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:33.286396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:33.286834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:33.287516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:33.287986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:33.288410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:33.349022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:33.357018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-84e18b73-883b-4ab8-904d-3f1a500c87d3 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082555 Nov 02 03:54:33.357565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1048/2101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:33 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:34.380269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:34.380887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:34.387405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:34.387887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:34.388354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:34.389040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:34.389488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:34.389911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:34.449320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:34.457363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7d2e94d7-2198-4f53-9ac5-479dcacf6b9b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080984 Nov 02 03:54:34.457918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1054/2102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:35.481773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:35.482434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:35.488863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:35.489342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:35.489777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:35.490463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:35.490916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:35.491336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:35.553870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:35.562831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e3518343-54ec-4f37-b6da-956c14da2346 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085440 Nov 02 03:54:35.563395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1049/2103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:35 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:36.585659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:36.586276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:36.593221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:36.593705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:36.594142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:36.594835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:36.595291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:36.595722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:36.659369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:36.668046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c693dcb6-f9b3-4e0d-b908-c6ee2e12b31f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086266 Nov 02 03:54:36.668721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1055/2104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:36 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:37.690610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:37.691216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:37.698110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:37.698598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:37.699009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:37.699682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:37.700149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:37.700569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:37.762724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:37.770858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f4736a8e-0d50-407d-a325-5841d4b45af6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084402 Nov 02 03:54:37.771412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1050/2105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:37 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:38.794119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:38.794736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:38.801140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:38.801621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:38.802057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:38.802739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:38.803193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:38.803616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:38.863120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:38.871825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b752b69e-7c04-47b8-852a-42d319359555 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081593 Nov 02 03:54:38.872417 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1056/2106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:38 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:39.895013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:39.895548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:39.902480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:39.902951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:39.903382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:39.904082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:39.904527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:39.904942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:39.964961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:39.973088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-930bb25c-238f-465d-9b98-a5f6e3a260cb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082050 Nov 02 03:54:39.973649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1051/2107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:39 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:40.995873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:40.996525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:41.003363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:41.003846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:41.004446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:41.005134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:41.005594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:41.006020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:41.071620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:41.079876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5b59d6ee-ab67-4aca-b43e-4e6b23277e36 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087839 Nov 02 03:54:41.080467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1057/2108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:40 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:42.103262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:42.103867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:42.110381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:42.110855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:42.111291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:42.111979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:42.112427 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:42.112844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:42.174385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:42.183162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-473a1d7f-c06a-4a32-a204-bf3053ea7990 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084259 Nov 02 03:54:42.183724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1052/2109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:42 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:43.205490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:43.206134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:43.212972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:43.213430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:43.213903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:43.214591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:43.215040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:43.215465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:43.276078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:43.284073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-465964fb-9c83-4e91-83e2-89a49f719122 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082393 Nov 02 03:54:43.284628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1058/2110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:43 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:44.306107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:44.306714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:44.313039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:44.313517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:44.313952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:44.314641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:44.315089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:44.315512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:44.375635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:44.384344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b8ac1830-37a9-429b-b8f8-959cd1706c3e tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081625 Nov 02 03:54:44.384900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1053/2111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:44 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:45.407165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:45.407781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:45.414289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:45.415364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:45.415805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:45.416522 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:45.416978 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:45.417405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:45.480210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:45.488586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-69091a1a-4c4f-4b0b-bc72-5ac2df2d38a0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085276 Nov 02 03:54:45.489145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1059/2112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:45 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:46.511852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:46.512487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:46.518814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:46.519288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:46.519720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:46.520437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:46.520883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:46.521304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:46.581714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:46.590381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-44def100-10c9-4967-a46e-f86cf6b45a92 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082945 Nov 02 03:54:46.590942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1054/2113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:46 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:47.613995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:47.614640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:47.621021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:47.621494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:47.621929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:47.622603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:47.623051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:47.623473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:47.683524 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:47.691545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5e2aa0dd-d6a2-4859-a50e-dab2572c9009 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081409 Nov 02 03:54:47.692130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1060/2114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:47 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:48.713030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:48.713640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:48.720002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:48.720481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:48.720910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:48.721580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:48.722026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:48.722439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:48.784346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:48.793035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ac10783f-d192-4ec6-b500-1e738c9d64e4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083972 Nov 02 03:54:48.793815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1055/2115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:48 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:49.816228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:49.816790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:49.823763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:49.824279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:49.824718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:49.825400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:49.825859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:49.826283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:49.889476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:49.897544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-19f5d8d1-0754-4274-9f64-ec38ffa6af8b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085286 Nov 02 03:54:49.898100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1061/2116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:49 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:50.920725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:50.921271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:50.927511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:50.928006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:50.928437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:50.929106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:50.929545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:50.929958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:50.932450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:50.994541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:51.002978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7d78a3cb-dfe2-4b32-a7da-ee5c5e1cec61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086217 Nov 02 03:54:51.003524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1056/2117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:50 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:52.026548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:52.027163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:52.034177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:52.034650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:52.035079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:52.035773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:52.036258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:52.036685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:52.097211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:52.105940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1b1eb9b0-5f0a-457c-8830-fe347d613da1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083974 Nov 02 03:54:52.106498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1062/2118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:52 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:53.128865 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:53.129424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:53.131679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:53.137560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:53.138039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:53.138467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:53.139151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:53.139596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:53.140043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:53.201114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:53.209266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cb267dd7-ac8f-4cd9-b4fc-0ceabbe9e844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084587 Nov 02 03:54:53.209821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1057/2119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:53 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:54.232295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:54.232970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:54.240233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:54.240995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:54.241435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:54.242128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:54.242579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:54.242999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:54.245647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:54:54.315035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:54.324311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4df3df28-731c-471e-9bde-df7498bf041b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.096107 Nov 02 03:54:54.324898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1063/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:54 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:55.349926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:55.350576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:55.357238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:55.357714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:55.358142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:55.358818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:55.359261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:55.359677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:55.421265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:55.429674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d688653c-c8c3-47fe-80c5-21bb0f8074f6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083687 Nov 02 03:54:55.430373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1058/2121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:55 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:56.452357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:56.452981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:56.459350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.459875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.460294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:56.460984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.461441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.461871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:56.523735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:56.532211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-73051b03-7ca0-4ae2-a181-976a042e3763 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083689 Nov 02 03:54:56.533119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1064/2122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:56 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:56.752567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:56.753111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:56.759629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.760137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.760569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:56.761445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.761937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.762567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:56.789825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:54:56.874521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1699a844-e644-4521-9a66-3cd3b2de85b3 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 204 len: 0 microversion: 2.1 time: 0.124876 Nov 02 03:54:56.876423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1059/2123] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:54:56 2022] DELETE /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:54:56.885375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:56.886254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:56.894870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.895376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.895825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:56.896574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:56.897029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:56.897510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:57.045787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:57.053398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-05ea7d8e-d9a7-42e4-b873-6c63ef68f1d6 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1508 microversion: 2.1 time: 0.171872 Nov 02 03:54:57.053963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1065/2124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:56 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:57.555198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:57.555867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:57.562279 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:57.562762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:57.563205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:57.563892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:57.564368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:57.564795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:57.626344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:57.635134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-122e5909-3bb1-451d-9dc3-5099ab672e7b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083617 Nov 02 03:54:57.635701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1060/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:57 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:58.077845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:58.079216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:58.085679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:58.086305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:58.087022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:58.088513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:58.089133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:58.089652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:58.160533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:58.169738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4632673e-a566-41a1-8ca6-77396a4c4676 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 200 len: 1466 microversion: 2.1 time: 0.096435 Nov 02 03:54:58.170718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1066/2126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:58 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 1466 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:58.215988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0", "name": "network-vif-deleted", "tag": "4c97f3b3-e1ee-4b0e-b586-9bac85860da9"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:54:58.225595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:58.226211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:58.226652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:58.239735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] Creating event network-vif-deleted:4c97f3b3-e1ee-4b0e-b586-9bac85860da9 for instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 on hv-cinder-86020 Nov 02 03:54:58.245364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-bd32f110-d786-48a5-bb0f-56ab180d3635 req-f3f4f65e-defb-4501-bb31-863e4ad14676 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101740 Nov 02 03:54:58.245960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1061/2127] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:54:58.660025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:58.660635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:58.666533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:58.667013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:58.667449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:58.668162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:58.668617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:58.669042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:58.728610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:58.736809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6e9717fa-c6e3-40fd-8200-5231a4b5b22f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.080723 Nov 02 03:54:58.737373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1067/2128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:58 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:59.193293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:59.193982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:59.202236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.202705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.203133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.203817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.204286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.204704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.218157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] HTTP exception thrown: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Request method failure captured: Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 HTTP/1.1 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUX7Fjpv_cpvBLq2XyaWk1SRwq4WNH8YyddLJ3eYAiY_7kt-S192VwaR9lEW_e8ZU9YRq6hina_0vlavYScXSX0Ri7J4OX8_WxC7R7XuIUT_jyITOODLtQrwQlWPBLOMZyTxNrxLgFDXwlWgFedVg6CLp1NWE_jjmm_qrosr-PhE7c Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:54:59.219735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}] Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: eed64456ec5c42b08df447e9a537c4d0 Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. Nov 02 03:54:59.221529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0'} Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:54:59.222627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. Nov 02 03:54:59.224543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:54:59.226073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Returning 404 to user: Instance 1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:54:59.226073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-07e39da8-65bb-4498-ae62-697cc0f6382e tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0" status: 404 len: 111 microversion: 2.1 time: 0.032023 Nov 02 03:54:59.226073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1062/2129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:59 2022] GET /compute/v2.1/servers/1299dc4b-fc01-48a7-8ce4-7cc3e81ee7f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:54:59.229541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:59.230041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:59.236378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.236853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.237287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.237962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.238412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.238833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.263884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:54:59.339597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b249efe2-2d88-46cc-9326-20a87560fd69 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 204 len: 0 microversion: 2.1 time: 0.113589 Nov 02 03:54:59.340188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1068/2130] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:54:59 2022] DELETE /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:54:59.349138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:59.349764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:59.355550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.356058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.356493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.357169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.357614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.358035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.489949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:59.497769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-50db61ad-dba0-42e7-9ced-55d15386a77b tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1522 microversion: 2.1 time: 0.153174 Nov 02 03:54:59.498321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1063/2131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:59 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:54:59.761588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:54:59.762215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:54:59.768065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.768541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.768977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.769654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:54:59.770098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:54:59.770515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:54:59.831581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:54:59.839747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e0b40fac-7e11-41f4-878d-5a009b27cbc7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083021 Nov 02 03:54:59.840346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1069/2132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:54:59 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:00.394156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be47a8e9-ddac-4b17-bbc7-11128bfcf574", "name": "network-vif-deleted", "tag": "a925dca0-bdfe-47a7-ac43-6e8cccf35cf9"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:00.408026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.408501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.408926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.422961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] Creating event network-vif-deleted:a925dca0-bdfe-47a7-ac43-6e8cccf35cf9 for instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 on hv-cinder-86020 Nov 02 03:55:00.428697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-375798c9-32dc-4b5c-806d-612d93080212 req-bb973fd3-bb1e-4f90-a42e-f7decc688af9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Nov 02 03:55:00.430247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1064/2133] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:55:00.521562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:00.522182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:00.529242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.529635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.530071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.530760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.531214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.531636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.566207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.566702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.567138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.567593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lazy-loading 'fault' on Instance uuid be47a8e9-ddac-4b17-bbc7-11128bfcf574 {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 03:55:00.609072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed64456ec5c42b08df447e9a537c4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4704c59a141a2a1abbb5abb65c994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:00.616787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a3a6c07-19d2-46fd-9bbb-d5c2c2e52d09 tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 200 len: 1312 microversion: 2.1 time: 0.099137 Nov 02 03:55:00.617340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1070/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:00 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:00.862873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:00.863515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:00.869704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.870181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.870616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.871300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:00.871752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:00.872198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:00.936336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:00.944486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77a615a5-0213-4253-b08c-1c5431a2167f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085884 Nov 02 03:55:00.945040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1065/2135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:00 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:01.640013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:01.640632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] [instance: be47a8e9-ddac-4b17-bbc7-11128bfcf574] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:01.647080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:01.647559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:01.648015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:01.648700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:01.649153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:01.649580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:01.664238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] HTTP exception thrown: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Request method failure captured: Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 HTTP/1.1 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUX7Fjpv_cpvBLq2XyaWk1SRwq4WNH8YyddLJ3eYAiY_7kt-S192VwaR9lEW_e8ZU9YRq6hina_0vlavYScXSX0Ri7J4OX8_WxC7R7XuIUT_jyITOODLtQrwQlWPBLOMZyTxNrxLgFDXwlWgFedVg6CLp1NWE_jjmm_qrosr-PhE7c Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:55:01.666349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a4704c59a141a2a1abbb5abb65c994"}]}] Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: c3a4704c59a141a2a1abbb5abb65c994 Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1595724520 Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: eed64456ec5c42b08df447e9a537c4d0 Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1595724520-project Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. Nov 02 03:55:01.668201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'be47a8e9-ddac-4b17-bbc7-11128bfcf574'} Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:55:01.669200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. Nov 02 03:55:01.670846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:55:01.672340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] Returning 404 to user: Instance be47a8e9-ddac-4b17-bbc7-11128bfcf574 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:55:01.672340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-99ec3262-2e4f-427a-a8c2-2932aa1c4a1f tempest-ServerRescueNegativeTestJSON-1595724520 tempest-ServerRescueNegativeTestJSON-1595724520-project] 10.222.0.26 "GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574" status: 404 len: 111 microversion: 2.1 time: 0.031561 Nov 02 03:55:01.672340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1071/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:01 2022] GET /compute/v2.1/servers/be47a8e9-ddac-4b17-bbc7-11128bfcf574 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 03:55:01.969260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:01.970026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:01.976273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:01.976752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:01.977181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:01.977859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:01.978302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:01.978720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:02.044449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:02.052659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-40440c15-79f7-4c54-9a5e-86f9b27a9e43 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087191 Nov 02 03:55:02.053457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1066/2137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:01 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:03.076658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:03.077202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:03.079615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:03.085446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:03.085941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:03.086383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:03.087088 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:03.087543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:03.087990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:03.179976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:03.188402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-28104819-9026-4c95-91cd-6f828494061c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.116165 Nov 02 03:55:03.188965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1072/2138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:03 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:04.211160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:04.212702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:04.220032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:04.220638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:04.221080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:04.221783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:04.222237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:04.222667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:04.313200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:04.325310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f6d2bf3-e227-4abc-840e-b34053f90158 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.118056 Nov 02 03:55:04.325887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1067/2139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:04 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:05.348257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:05.348874 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:05.355765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:05.356277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:05.356710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:05.357568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:05.357841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:05.358262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:05.420142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:05.428246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1e815a14-82eb-40bf-98df-8d0b73cf9de5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083858 Nov 02 03:55:05.428800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1073/2140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:05 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:06.452752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:06.454102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:06.460576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:06.461057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:06.461498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:06.462192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:06.462641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:06.463059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:06.542505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:06.551122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8d7e7919-0613-4abe-a0e5-e99895d83c12 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.102945 Nov 02 03:55:06.551699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1068/2141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:06 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:07.575160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:07.575786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:07.582659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:07.583159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:07.583632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:07.584564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:07.585053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:07.585486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:07.661108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:07.669998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3f81c836-0c23-43cb-8ce5-8414ff646334 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.099114 Nov 02 03:55:07.670585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1074/2142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:07 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:08.692924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:08.694239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:08.700564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:08.701047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:08.701491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:08.702184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:08.702640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:08.703217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:08.770881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:08.779579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-05fa91d3-8b4e-4714-86fb-3ce7a5da9b4d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.090597 Nov 02 03:55:08.780210 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1069/2143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:08 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:09.803980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:09.804595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:09.812109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:09.812599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:09.813094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:09.813805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:09.814269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:09.816202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:09.877135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:09.885269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d19cfeae-7332-400e-87d8-e008a83bed64 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085121 Nov 02 03:55:09.885836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1075/2144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:09 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:10.908041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:10.908868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:10.915305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:10.915782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:10.916250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:10.916939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:10.917390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:10.917817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:10.987105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:10.995918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bde25e3d-2606-434b-bcdf-a17b13142cb2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.091722 Nov 02 03:55:10.996501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1070/2145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:10 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:12.019335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:12.019944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:12.027040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:12.027513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:12.027972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:12.028649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:12.029098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:12.029516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:12.089403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:12.097402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-db6e11ee-55e2-492f-88e1-c8a8cb2a5b72 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081885 Nov 02 03:55:12.097956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1076/2146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:12 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:13.119822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:13.120459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:13.127021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:13.127492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:13.127920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:13.128620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:13.129064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:13.129479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:13.192172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:13.200225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-378cad8d-a0cf-49ea-a187-dde6d0977aaf tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084253 Nov 02 03:55:13.200782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1071/2147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:13 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:14.223256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:14.223872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:14.230786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:14.231257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:14.231688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:14.232386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:14.232834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:14.233251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:14.293382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:14.301301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f8acd74d-9ca7-4321-b492-d38305d9ea71 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081930 Nov 02 03:55:14.301854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1077/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:14 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:15.325109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:15.325719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:15.333078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:15.333560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:15.333995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:15.334678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:15.335128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:15.335551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:15.396480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:15.404639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d6e8a475-4d29-4887-98ac-05ac8fe0b44d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084014 Nov 02 03:55:15.405196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1072/2149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:15 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:16.426974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:16.427580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:16.434017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:16.434488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:16.434914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:16.435595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:16.436066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:16.436488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:16.452797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:16.502736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:16.510783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0da76fb0-213f-413f-9265-3fc53366106c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.087661 Nov 02 03:55:16.511331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1078/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:16 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:17.534281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:17.534964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:17.541365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:17.541839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:17.542267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:17.542948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:17.543389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:17.544416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:17.547025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:17.608925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:17.616920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8ae52201-8fa4-413d-baee-76f1d8b94508 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.086543 Nov 02 03:55:17.617475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1073/2151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:18.639766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:18.640415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:18.646945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:18.647426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:18.647865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:18.648575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:18.649031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:18.649457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:18.710072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:18.718295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f3c45e0-5061-421e-a66f-1e6902f38e53 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082394 Nov 02 03:55:18.718857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1079/2152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:18 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:55:19.741448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:19.742065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:19.749074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:19.749551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:19.750239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:19.750921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:19.751376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:19.751798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:19.812442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:19.820514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0388ba25-e45d-4643-9a33-b8621d18ce2d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083060 Nov 02 03:55:19.825923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1074/2153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:19 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:20.844645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:20.845202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:20.851612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:20.852135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:20.852579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:20.853267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:20.853723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:20.854151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:20.914890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:20.922970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a92df37-36a0-4a3e-beee-fc8de4524a5f tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082787 Nov 02 03:55:20.923531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1080/2154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:20 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:21.945565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:21.946215 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:21.952627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:21.953106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:21.953544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:21.954229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:21.954681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:21.955108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:22.018403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:22.026584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-14817b8e-7402-4a0e-9112-888ec88c44cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084910 Nov 02 03:55:22.027143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1075/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:21 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:23.049745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:23.050393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:23.056786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:23.057269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:23.057711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:23.058396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:23.058853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:23.059788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:23.120504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:23.129464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-afc3fcb6-d187-413c-9149-32e46ee3fc41 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083673 Nov 02 03:55:23.130030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1081/2156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:23 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:24.152367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:24.153603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:24.155591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:55:24.155742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa (ip 10.222.0.26) !!! Nov 02 03:55:24.156756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:24.163223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:24.163705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:24.164174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:24.164871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:24.165324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:24.165748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:24.233705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:24.241956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f975373-8426-4268-a4ee-8f378be9701d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.093615 Nov 02 03:55:24.242526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1076/2157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:24 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:25.265388 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:25.265994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:25.272487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:25.272960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:25.273392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:25.274065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:25.274510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:25.274927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:25.342071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:25.350031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f249bf84-775c-4a46-be4d-61899019f49c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.088642 Nov 02 03:55:25.350581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1082/2158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:25 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:26.373766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:26.374373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:26.381121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:26.381599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:26.382031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:26.382709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:26.383153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:26.383574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:26.445933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:26.454949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0b2f7031-06e1-444d-be99-99753bef0349 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085481 Nov 02 03:55:26.455478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1077/2159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:26 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:27.478637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:27.479254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:27.485540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:27.486018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:27.486453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:27.487140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:27.487602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:27.488056 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:27.551791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:27.560633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-01ba3ce4-eee5-4069-9475-22922f85c9ca tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085871 Nov 02 03:55:27.561195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1083/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:27 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:28.583770 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:28.584407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:28.591377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:28.591855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:28.592318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:28.592999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:28.593449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:28.593873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:28.654148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:28.662134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9aaae1a8-a8f3-4520-88dc-f57cecd6b8ec tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.082248 Nov 02 03:55:28.662692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1078/2161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:28 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:29.685076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:29.685687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:29.692217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:29.692695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:29.693126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:29.693802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:29.694247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:29.694666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:29.757257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:29.765988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-550a703f-d40c-47f9-a1eb-6748f7db6a97 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.085230 Nov 02 03:55:29.766541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1084/2162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:29 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:30.788749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:30.789293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:30.796584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:30.797089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:30.797527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:30.798211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:30.798663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:30.799085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:30.861379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:30.869405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7673a987-1ee2-41b3-9071-891daae4bedd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.084572 Nov 02 03:55:30.869974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1079/2163] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:30 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:31.892717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:31.893331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:31.899911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:31.900427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:31.900858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:31.901539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:31.901988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:31.902407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:31.962565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:31.970624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-120d5bf0-25cd-41cc-9b9f-6d6683a9dc9a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081693 Nov 02 03:55:31.971178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1085/2164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:31 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:32.992394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:32.992999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:32.999927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:33.000420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:33.000846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:33.001520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:33.001960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:33.002377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:33.061855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:33.069786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5c93e053-d8ae-4c67-b92c-9f276a602e1c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.081212 Nov 02 03:55:33.070347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1080/2165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:32 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:55:34.093250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:34.093858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:34.096165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:34.101377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:34.101849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:34.102283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:34.102957 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:34.103403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:34.103820 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:34.164115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:34.172845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b77f15a7-9e95-4755-bcb5-97cbb5d3e091 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 200 len: 1372 microversion: 2.1 time: 0.083929 Nov 02 03:55:34.173401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1086/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:34 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:34.195068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3a082f62-8754-4f61-9b18-31cb6ba4b69c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '.version_select at 0x7f5c92467af0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:34.218563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3a082f62-8754-4f61-9b18-31cb6ba4b69c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-533096675" status: 202 len: 0 microversion: 2.1 time: 0.027217 Nov 02 03:55:34.219124 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1081/2167] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 03:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-533096675 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 03:55:35.222645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5dd6b82f-3cdc-400c-84fc-26d05a010af8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: .version_select at 0x7f5c924e0a60>, body: {"keypair": {"name": "tempest-keypair-1136729239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTs5TEPFFr50J+xysri8VF4uxcklB8zHLd/nNK+OfP1MXTEp0LqH9wKStKSWZBT/qxcfsU/AoooEzOH+ihksjZU/j1IY1F/4sxgD0RBxYX9H8QJPIR4J8oWf4xPjbfwQ=="}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:35.239158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-5dd6b82f-3cdc-400c-84fc-26d05a010af8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:55:35.243703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-5dd6b82f-3cdc-400c-84fc-26d05a010af8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:55:35.268914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5dd6b82f-3cdc-400c-84fc-26d05a010af8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050169 Nov 02 03:55:35.269467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1087/2168] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 03:55:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:55:36.520662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1514875301", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e09a0e-4e79-4d08-a329-49c34bfe3e5f"}], "security_groups": [{"name": "tempest-securitygroup--1699086958"}], "key_name": "tempest-keypair-1136729239", "user_data": "}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:36.621040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] validate_networks() for [('d4e09a0e-4e79-4d08-a329-49c34bfe3e5f', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 03:55:37.153205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 03:55:37.153610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 03:55:37.154205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 03:55:37.154618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 03:55:37.155156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 03:55:37.164326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:37.164811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:37.165249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:37.165976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:37.166429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:37.167005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:37.188012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 03:55:37.192570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 03:55:37.205899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 03:55:37.208906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 03:55:37.256621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-910ecf4f-10de-4cb4-8d3f-7b1c1c6527ea tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.740718 Nov 02 03:55:37.257526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1082/2169] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 03:55:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 03:55:37.269684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7774377b-fe97-4922-b7cb-9089cf3f7f52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:37.270900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7774377b-fe97-4922-b7cb-9089cf3f7f52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:37.277429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:55:37.277806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:55:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d (ip 10.222.0.26) !!! Nov 02 03:55:37.331911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7774377b-fe97-4922-b7cb-9089cf3f7f52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:37.339257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7774377b-fe97-4922-b7cb-9089cf3f7f52 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1242 microversion: 2.1 time: 0.073499 Nov 02 03:55:37.339853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1088/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:37 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:55:38.362079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:38.362696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:38.369000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:38.369483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:38.369939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:38.370617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:38.371085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:38.371506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:38.432736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:38.440259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-314db712-b24c-4833-a161-15c16a98ebc1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1294 microversion: 2.1 time: 0.082506 Nov 02 03:55:38.440814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1083/2171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:38 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:39.463562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:39.464274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:39.470622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:39.471103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:39.471545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:39.472232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:39.472680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:39.473124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:39.616482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:39.625440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6d72d3af-3f30-44f8-a938-d2d366853746 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.165862 Nov 02 03:55:39.640274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1089/2172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:39 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:40.243588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9474bf60-b056-4517-8d79-aee88adc9b4d", "tag": "4a21016c-1ed6-402f-adef-37dd2c2f184a"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:40.254980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:40.255495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:40.255987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:40.274416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] Creating event network-changed:4a21016c-1ed6-402f-adef-37dd2c2f184a for instance 9474bf60-b056-4517-8d79-aee88adc9b4d on hv-cinder-86020 Nov 02 03:55:40.280724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-37e9872e-f49f-4beb-8e4f-304a29fc76f0 req-3a54885a-e588-450f-8e7d-01f1587b5489 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040703 Nov 02 03:55:40.281336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1084/2173] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:55:40.649160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:40.649969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:40.657394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:40.657878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:40.658311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:40.659001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:40.659449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:40.659878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:40.791852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:40.799467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-74f76883-da19-4b08-b81c-7ee23772e8f2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.154139 Nov 02 03:55:40.800036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1090/2174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:40 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:41.822333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:41.822919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:41.829780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:41.830257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:41.830689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:41.831384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:41.831830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:41.832289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:41.976687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:41.985173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d7a82f28-000d-4819-aa80-4ce3ab5a3b25 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.167093 Nov 02 03:55:41.985760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1085/2175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:41 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:43.008100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:43.008741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:43.015702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:43.016207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:43.016642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:43.017343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:43.017791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:43.018210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:43.147427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:43.155068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb1e8930-17f4-43dc-a409-9db53193eb84 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.150853 Nov 02 03:55:43.155630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1091/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:43 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:44.176785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:44.177404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:44.183778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:44.184295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:44.184737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:44.185426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:44.185878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:44.186304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:44.313172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:44.320911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-581e213a-b6e3-4dce-8bab-22640dbb834b tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.147911 Nov 02 03:55:44.321471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1086/2177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:44 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:45.344812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:45.345442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:45.351831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:45.352351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:45.352790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:45.353541 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:45.353994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:45.354422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:45.486872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:45.494730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c1d716fb-2f5a-4bc8-8b42-fc772ea8dafd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.153803 Nov 02 03:55:45.495304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1092/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:45 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:46.517144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:46.518422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:46.524833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:46.525327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:46.525761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:46.526636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:46.527676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:46.528170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:46.652980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:46.660478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0fca5ae8-54b5-4efb-90d1-428f9c497b01 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.147221 Nov 02 03:55:46.661037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1087/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:46 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:47.062135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9474bf60-b056-4517-8d79-aee88adc9b4d", "name": "network-vif-plugged", "status": "completed", "tag": "4a21016c-1ed6-402f-adef-37dd2c2f184a"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:47.071299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:47.071780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:47.072249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:47.076810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=76 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:47.085843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] Creating event network-vif-plugged:4a21016c-1ed6-402f-adef-37dd2c2f184a for instance 9474bf60-b056-4517-8d79-aee88adc9b4d on hv-cinder-86020 Nov 02 03:55:47.091448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-483de5b3-2156-42fc-a138-6ebf24955c9c req-57926d45-f496-44c7-9237-55cdbc2ac8be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151976 Nov 02 03:55:47.092064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1093/2180] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:55:47.683158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:47.683672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:47.685802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:47.686569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:47.692447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:47.692928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:47.693354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:47.694032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:47.694474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:47.694896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:47.697557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=76 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:47.822932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:47.831000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bb8059be-cd8d-4279-9433-a9238fad9f26 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.151819 Nov 02 03:55:47.831564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1088/2181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:47 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:48.854982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:48.855662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:48.858301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:55:48.864497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:48.864984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:48.865423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:48.866114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:48.866567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:48.867029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:49.000678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:49.008521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a1235c4f-a1a6-48da-97a0-bc254c049ff6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1368 microversion: 2.1 time: 0.157782 Nov 02 03:55:49.009093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1094/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:48 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:50.032203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:50.032825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:50.039558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:50.040057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:50.040490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:50.041175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:50.041617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:50.042038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:50.170117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:55:50.179000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-64b694ed-bbb6-4fc9-9a9b-7486b6aac1e2 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1558 microversion: 2.1 time: 0.151119 Nov 02 03:55:50.179563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1089/2183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:55:50 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:55:50.202591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:55:50.203113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:55:50.209720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:50.210203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:50.210645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:50.211334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:50.211788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:50.212240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:50.287017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bbefc920-d4af-4016-91f6-799f36de740d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088873 Nov 02 03:55:50.287607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1095/2184] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 03:55:50 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:55:51.240188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9474bf60-b056-4517-8d79-aee88adc9b4d", "tag": "4a21016c-1ed6-402f-adef-37dd2c2f184a"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:55:51.249579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:55:51.250381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:55:51.250823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:55:51.261616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] Creating event network-changed:4a21016c-1ed6-402f-adef-37dd2c2f184a for instance 9474bf60-b056-4517-8d79-aee88adc9b4d on hv-cinder-86020 Nov 02 03:55:51.266786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-700dc3d0-1fb5-4e4b-a3ad-a7ed9768a861 req-f9eafdd5-5d4e-4adc-8ce1-ca1ecc3ca8f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091731 Nov 02 03:55:51.267399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1090/2185] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:56:27.020896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:27.021650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=11 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:27.025837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:56:27.026335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:56:27.033358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:27.033846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:27.034288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:27.035010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:27.035465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:27.035895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:27.060224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5db6dda9-0199-4a2a-98bc-0f72754f25a4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d/ips" status: 200 len: 150 microversion: 2.1 time: 0.040818 Nov 02 03:56:27.060808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1096/2186] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 03:56:27 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:56:57.560274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:57.560986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=13 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:57.566160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:56:57.566858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:56:57.574579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:57.575220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:57.576560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:57.577459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:57.578070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:57.578857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:57.611582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 03:56:57.692750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6bf31364-ee01-4592-a604-4d5d54e5993f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 204 len: 0 microversion: 2.1 time: 0.134631 Nov 02 03:56:57.693892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1091/2187] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 03:56:57 2022] DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 03:56:57.703698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:56:57.704839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:56:57.707367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:57.708224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=4 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:56:57.714819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:57.715304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:57.715747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:57.716509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:57.717478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:57.717903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:57.863070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:56:57.871436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-314436b2-0bde-4943-96e5-f63bb7031593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.172598 Nov 02 03:56:57.872111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1097/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:56:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:56:58.897298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:56:58.898021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:56:58.908227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:58.908793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:58.909257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:58.910079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:56:58.910542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:56:58.910970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:56:59.043107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:56:59.051464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fd52d9a5-7946-4b81-aa43-a31c7baf310b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.158449 Nov 02 03:56:59.063976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1092/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:56:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:00.075397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:00.076049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:00.082427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:00.082941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:00.083411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:00.084141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:00.084598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:00.085030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:00.212278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:00.220956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c8087267-b14b-426b-9944-04d150c35cd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149410 Nov 02 03:57:00.221512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1098/2190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:01.244703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:01.245312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:01.252551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:01.253021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:01.253451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:01.254153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:01.254597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:01.255012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:01.382207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:01.390199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c19b3656-c11e-4732-bdae-72d6d0fcad06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149345 Nov 02 03:57:01.390786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1093/2191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:02.413493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:02.414024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:02.420386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:02.420860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:02.421291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:02.421966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:02.422412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:02.422833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:02.547253 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:02.555344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eda16b06-50d4-4c79-99d8-68a13f9882f1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145808 Nov 02 03:57:02.555897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1099/2192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:03.578547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:03.579160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:03.585573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:03.586047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:03.586481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:03.587157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:03.587605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:03.588054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:03.718316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:03.727082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f38425b7-cfd1-4da3-92c6-b0e986c476a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152343 Nov 02 03:57:03.727655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1094/2193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:04.751425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:04.752113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:04.758467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:04.758952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:04.759394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:04.760115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:04.760574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:04.761006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:04.891576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:04.899881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fe194a3d-f84c-4202-a4cd-b57e45736a83 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.153068 Nov 02 03:57:04.900470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1100/2194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:05.923356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:05.923922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:05.930535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:05.931013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:05.931451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:05.932168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:05.932617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:05.933038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:06.060242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:06.068355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6dc1bafb-4a8b-44dd-bab7-231824b65f08 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148905 Nov 02 03:57:06.068913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1095/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:07.092471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:07.093082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:07.099390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:07.099877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:07.100344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:07.101031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:07.101481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:07.101906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:07.225877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:07.234607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b9493dd5-3ff0-403a-9575-7182bfa55156 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146955 Nov 02 03:57:07.235166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1101/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:08.257174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:08.257812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:08.264371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:08.264850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:08.265287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:08.265972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:08.266425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:08.266847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:08.390549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:08.399355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ab14f4bf-b966-45ea-af97-e00803bb0d1a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146000 Nov 02 03:57:08.399917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1096/2197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:09.423363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:09.424021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:09.430549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:09.431022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:09.431454 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:09.432162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:09.432617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:09.433037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:09.561614 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:09.569988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c2ba1683-9da7-431f-872a-5e870e613b93 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151083 Nov 02 03:57:09.570544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1102/2198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:10.593173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:10.593786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:10.600141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:10.600616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:10.601048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:10.601726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:10.602174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:10.602594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:10.730109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:10.738841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-13a1c79b-6544-45b3-b383-4208f474668e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149554 Nov 02 03:57:10.739446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1097/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:57:11.761563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:11.762239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:11.769135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:11.769609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:11.770040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:11.770716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:11.771164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:11.771589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:11.898215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:11.906894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3361d1ba-967f-4dbe-9023-9586505d9baf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149250 Nov 02 03:57:11.907465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1103/2200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:12.929941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:12.930561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:12.937397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:12.937876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:12.938310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:12.938989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:12.939437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:12.939856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:13.064656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:13.072753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ab3cda4-6062-4a40-a651-5480124997c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146656 Nov 02 03:57:13.073315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1098/2201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:14.097584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:14.098191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:14.104526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:14.105005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:14.105441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:14.106118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:14.106567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:14.106985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:14.230829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:14.238964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2e74ef31-52d7-40e2-ad37-f44b03545ec0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145269 Nov 02 03:57:14.239537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1104/2202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:15.261404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:15.262013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:15.268895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:15.269368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:15.269798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:15.270473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:15.270916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:15.271332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:15.398817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:15.406916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b8fe5daf-2238-4f3d-b090-3b011abb1109 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149381 Nov 02 03:57:15.407468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1099/2203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:16.430048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:16.430667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:16.437096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:16.437578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:16.438015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:16.438697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:16.439152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:16.439577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:16.565995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:16.574122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9a10599-b46c-438d-9e45-64f41ede8e26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147977 Nov 02 03:57:16.574683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1105/2204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:17.597981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:17.598628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:17.604961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:17.605439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:17.605877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:17.606560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:17.607012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:17.607436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:17.954679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:17.962860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0b73e752-13f8-4577-bd85-374b023faa72 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.368764 Nov 02 03:57:17.963428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1100/2205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:18.986652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:18.987260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:18.993896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:18.994380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:18.994805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:18.995481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:18.995929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:18.996378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:19.120882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:19.129271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da85ce21-4d91-45b9-840d-09a2c5dab0c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147100 Nov 02 03:57:19.129827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1106/2206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:20.152406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:20.153019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:20.159514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:20.160016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:20.160455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:20.161133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:20.161583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:20.162005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:20.288120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:20.296773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4e172308-db53-4a0b-ab14-96dccc42755e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148428 Nov 02 03:57:20.297338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1101/2207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:21.320494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:21.321058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:21.327665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:21.328052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:21.328495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:21.329184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:21.329639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:21.330067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:21.461406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:21.470209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3a06d7f6-b908-4c5c-9130-b4a1e64c7fcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.153661 Nov 02 03:57:21.470767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1107/2208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:22.493585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:22.494192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:22.501479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:22.501961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:22.502399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:22.503084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:22.503539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:22.503987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:22.632739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:22.640876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-51f06d78-ae54-4363-b9f0-ce86bbbf77fd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151175 Nov 02 03:57:22.641442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1102/2209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:23.665073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:23.665692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:23.672702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:23.673186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:23.673622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:23.674309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:23.674767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:23.675192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:23.799428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:23.807630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-57384b09-adc8-4d83-bb85-2ebf0ffb349f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146426 Nov 02 03:57:23.808221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1108/2210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:24.830650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:24.831179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:24.837234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:24.837712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:24.838147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:24.838861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:24.839310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:24.839737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:24.963846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:24.972551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4634fe60-0327-4cdb-a471-ee368621a198 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145819 Nov 02 03:57:24.973109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1103/2211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:25.996337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:25.996952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:26.003769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:26.004294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:26.004737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:26.005423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:26.005875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:26.006331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:26.133276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:26.141877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d642e989-805e-4b26-9b57-da68c70633a5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149405 Nov 02 03:57:26.142432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1109/2212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:27.165625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:27.166239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:27.173223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:27.173702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:27.174139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:27.174820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:27.175267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:27.175684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:27.301240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:27.309616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-95b2514e-78e3-4aae-b7c7-e5e7dd0d6c76 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147911 Nov 02 03:57:27.310181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1104/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:28.332822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:28.333455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:28.335428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=27 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:28.340723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:28.341205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:28.341643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:28.342358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:28.342812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:28.343240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:28.345935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=79 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:28.470530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:28.478683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2ac7923-c0b3-4eed-ac2d-79ed4647ee2c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149729 Nov 02 03:57:28.479244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1110/2214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:29.502564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:29.503151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:29.505723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:29.511105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:29.511606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:29.512191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:29.512871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:29.513315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:29.513731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:29.518338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:29.642551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:29.650693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7f4603b3-2d8e-4b53-a7f1-d7ac8e4043fe tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152249 Nov 02 03:57:29.651244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1105/2215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:30.674121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:30.674722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:30.681469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:30.681942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:30.682370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:30.683053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:30.683496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:30.683912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:30.811435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:30.819521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ef246ed8-7a49-4083-a7c4-10f7ecbe362b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149246 Nov 02 03:57:30.820111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1111/2216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:31.843655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:31.844295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:31.850782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:31.851256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:31.851688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:31.852404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:31.852854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:31.853282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:31.981743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:31.989884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-920ff5db-ddf8-4b0f-82d4-860fe757df85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.150544 Nov 02 03:57:31.990439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1106/2217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:33.013525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:33.014141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:33.020601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:33.021085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:33.021520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:33.022205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:33.022657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:33.023079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:33.148398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:33.157121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-60646885-9f0b-44f8-b804-2002c158f2f7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147404 Nov 02 03:57:33.157624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1112/2218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:34.181061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:34.181656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:34.188509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:34.188982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:34.189413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:34.190092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:34.190535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:34.190953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:34.319040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:34.327076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4f916c70-c24c-4675-b9c4-a776a4ecdcd0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149917 Nov 02 03:57:34.327635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1107/2219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:35.350110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:35.350727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:35.357090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:35.357577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:35.358593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:35.359283 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:35.359740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:35.360198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:35.483473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:35.492210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-43e59cd8-1fce-4dd7-b137-f5d51d74c4a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145990 Nov 02 03:57:35.492780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1113/2220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:36.515767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:36.516466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:36.522899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:36.523832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:36.524293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:36.524980 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:36.525434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:36.525862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:36.655528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:36.663710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf132de8-764e-4280-a2c8-a3debb19d438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152379 Nov 02 03:57:36.664300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1108/2221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:37.338574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:37.339092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:37.346074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.346549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.346981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.347662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.348136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.348555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.364170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 HTTP/1.1 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 03:57:37.365877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.367834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '226afa75-e26e-405b-b366-e8afb74d7116'} Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:57:37.368798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.370303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.371730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:57:37.371730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0605a8d1-41f2-41c6-9251-be90d84a9925 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 404 len: 111 microversion: 2.20 time: 0.032669 Nov 02 03:57:37.371730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1114/2222] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 03:57:37 2022] DELETE /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 03:57:37.376438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:37.377048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: 226afa75-e26e-405b-b366-e8afb74d7116] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:37.382967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.383444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.383883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.384590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.385037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.385463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.399421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 HTTP/1.1 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 03:57:37.401186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.402931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '226afa75-e26e-405b-b366-e8afb74d7116'} Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 03:57:37.403943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. Nov 02 03:57:37.406313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 03:57:37.407820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance 226afa75-e26e-405b-b366-e8afb74d7116 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 03:57:37.407820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-79dcddb3-386f-42cb-b6e4-a8287476977f tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116" status: 404 len: 111 microversion: 2.20 time: 0.030236 Nov 02 03:57:37.407820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1109/2223] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 03:57:37 2022] GET /compute/v2.1/servers/226afa75-e26e-405b-b366-e8afb74d7116 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 03:57:37.687537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:37.688114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:37.694195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.694673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.695104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.695777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:37.696298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:37.696703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:37.821331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:37.830045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bf39784a-ea41-495c-b092-4eb54ce04fe7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147275 Nov 02 03:57:37.830594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1115/2224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:38.853134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:38.853742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:38.860681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:38.861159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:38.861586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:38.862265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:38.862708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:38.863122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:38.988017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:38.996035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8b585ea-ca83-4af4-9c63-5d8d1dea7e13 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146647 Nov 02 03:57:38.996584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1110/2225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:40.019797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:40.020428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:40.026802 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:40.027282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:40.027711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:40.028510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:40.028948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:40.029371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:40.157426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:40.165459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7dd37363-10c0-4c5f-89c1-baf7f41b55a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149535 Nov 02 03:57:40.166009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1116/2226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:41.188815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:41.189423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:41.195711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:41.196213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:41.196646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:41.197328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:41.197771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:41.198216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:41.477922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:41.485977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-aacc72c9-402f-417b-80a3-74fa88f18f0f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.301123 Nov 02 03:57:41.486527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1111/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:42.510433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:42.511081 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:42.517981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:42.518463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:42.518903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:42.519590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:42.520075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:42.520505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:42.649166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:42.657939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8b6d3bc3-5e41-4828-a183-e1f9a88f8ad8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151420 Nov 02 03:57:42.658500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1117/2228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:43.680948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:43.681559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:43.689187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:43.689663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:43.690093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:43.690764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:43.691208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:43.691624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:43.820641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:43.829335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3db4a9e2-5741-4b57-8fe5-8c8694abb395 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152219 Nov 02 03:57:43.829890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1112/2229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:57:44.852647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:44.853175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:44.860438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:44.861292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:44.862093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:44.863319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:44.864227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:44.864996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:45.007742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:45.016215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ecb41161-029e-4ee7-b8e3-07d3f433ba14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.167515 Nov 02 03:57:45.016790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1118/2230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:46.041920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:46.042523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:46.048863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:46.049345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:46.049781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:46.050461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:46.050914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:46.051338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:46.178660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:46.187421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5338747a-4197-441c-ad81-d5858392b9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149329 Nov 02 03:57:46.188001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1113/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:47.211047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:47.211660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:47.218031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:47.218515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:47.218956 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:47.219644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:47.220128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:47.220556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:47.345695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:47.353835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4e2d0e2e-f521-45e9-8b47-bbf119dd9f4f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146701 Nov 02 03:57:47.354398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1119/2232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:48.377387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:48.377986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:48.384409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:48.384891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:48.385322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:48.386000 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:48.386442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:48.386860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:48.515545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:48.523728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-55a0f278-c6cf-43f3-9edc-632d81fdaeef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.150422 Nov 02 03:57:48.524328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1114/2233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:49.547121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:49.547740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:49.554162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:49.554646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:49.555082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:49.555765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:49.556256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:49.556680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:49.684247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:49.692364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b6130532-ab0d-41ae-85d4-b52b1175cbe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149596 Nov 02 03:57:49.692923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1120/2234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:50.714528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:50.715123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:50.721447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:50.721926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:50.722356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:50.723030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:50.723474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:50.723889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:50.854889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:50.863481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6a7a560c-1ba2-42a4-b828-a95c242e2ce4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152795 Nov 02 03:57:50.864048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1115/2235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:51.887768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:51.888470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:51.895410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:51.895891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:51.896363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:51.897055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:51.897512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:51.897941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:52.024934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:52.033103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f46832ff-3cec-4f98-b038-3d9c718a2625 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149205 Nov 02 03:57:52.033667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1121/2236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:53.056278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:53.056999 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:53.063343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:53.063818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:53.064313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:53.064993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:53.065437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:53.065854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:53.193978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:53.202751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b0343dc-8bfe-4a3c-8a12-9ab9a02da9b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.150369 Nov 02 03:57:53.203496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1116/2237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:54.226700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:54.227314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:54.234384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:54.234875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:54.235380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:54.236126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:54.236581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:54.237006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:54.370345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:54.378805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-30b15a04-62be-4f4c-97b6-f31944944b6a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.156046 Nov 02 03:57:54.379370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1122/2238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:55.402144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:55.402692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:55.408831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:55.409303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:55.409733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:55.410411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:55.410852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:55.411264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:55.536426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:55.545257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-af791903-bbe2-4b26-beba-d94cd72110ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146600 Nov 02 03:57:55.545820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1117/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:56.568733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:56.569340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:56.575808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:56.576325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:56.576754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:56.577432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:56.577880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:56.578308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:56.708073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:56.716208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-35c3a49f-c32a-4e73-a090-31cc5c04d617 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151300 Nov 02 03:57:56.717374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1123/2240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:57:57.739757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:57.740402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:57.746746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:57.747221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:57.747672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:57.748379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:57.748887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:57.749313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:57.877141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:57.885259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-70c2a631-468f-495c-a69d-862b7afa94a0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149329 Nov 02 03:57:57.885820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1118/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:57:58.909437 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:57:58.910061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:57:58.911818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:58.917021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:58.917505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:58.917942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:58.918625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:57:58.919080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:57:58.920188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:57:58.924197 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=80 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:57:59.044567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:57:59.052639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7ecfb644-d801-45dd-aeab-ce9b06d7db0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147331 Nov 02 03:57:59.053208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1124/2242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:57:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:00.075293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:00.075887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:00.078327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:00.083610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:00.084143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:00.084581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:00.085262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:00.085714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:00.086137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:00.090010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=80 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:00.214750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:00.223426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58742b58-93a7-438d-bdd5-2e5313be03ec tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152001 Nov 02 03:58:00.224002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1119/2243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:01.246975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:01.247636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:01.254883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:01.255369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:01.255809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:01.256525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:01.256986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:01.257411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:01.381985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:01.390092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0a793e48-bcb7-449e-84ef-8f883292e31f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146964 Nov 02 03:58:01.390658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1125/2244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:02.413213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:02.413772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:02.420691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:02.421164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:02.421595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:02.422266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:02.422713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:02.423139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:02.551111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:02.559234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d8e01769-1ceb-486f-9fd8-4d4ca94429c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149928 Nov 02 03:58:02.559784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1120/2245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:03.582245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:03.582889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:03.589287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:03.589769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:03.590206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:03.590895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:03.591351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:03.591776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:03.714979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:03.723022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-591a7d76-0575-48a6-9c73-34dc8db7c37c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.144687 Nov 02 03:58:03.723582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1126/2246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:04.746975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:04.748141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:04.754750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:04.755226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:04.755662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:04.756371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:04.756824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:04.757246 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:04.885447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:04.894123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f8654348-6894-4213-9ab2-003f3a95c310 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151022 Nov 02 03:58:04.894680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1121/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:05.917215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:05.917762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:05.924183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:05.924662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:05.925097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:05.925800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:05.926231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:05.926654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:06.050041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:06.058079 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0e38f261-c88a-4430-858e-5912bb057f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.144819 Nov 02 03:58:06.058635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1127/2248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:07.081421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:07.082155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:07.089043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:07.089523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:07.089975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:07.090733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:07.091694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:07.092160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:07.217540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:07.225658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2f1acab1-a6f7-49ce-bde1-03e40e3ef145 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148129 Nov 02 03:58:07.226219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1122/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:08.250112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:08.250729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:08.257229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:08.257710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:08.258148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:08.258840 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:08.259296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:08.259723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:08.390077 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:08.398204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-87784549-8ecf-424a-82be-f671270769da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152795 Nov 02 03:58:08.398765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1128/2250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:09.422755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:09.423374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:09.429869 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:09.430350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:09.430788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:09.431476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:09.431933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:09.432389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:09.557699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:09.565840 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fabb56a0-eef9-432a-93fa-54743f2ebf0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147512 Nov 02 03:58:09.566401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1123/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:10.590335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:10.590980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:10.597306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:10.597777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:10.598207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:10.598882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:10.599332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:10.599750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:10.726789 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:10.735163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f8d7a254-6f36-49c9-b02b-570b9221270f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148756 Nov 02 03:58:10.735735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1129/2252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:11.759204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:11.759818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:11.766795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:11.767272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:11.767708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:11.768421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:11.768870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:11.769291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:11.893570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:11.901908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d90d2aae-cee7-49f3-adcc-29a6a9159be9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146600 Nov 02 03:58:11.902477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1124/2253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:12.925168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:12.925805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:12.932098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:12.932575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:12.933008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:12.933683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:12.934130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:12.934549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:13.057738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:13.066268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-01546e22-3e0b-4ea8-8bdd-bcdec8e8fc79 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.144931 Nov 02 03:58:13.066823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1130/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:14.089868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:14.090481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:14.096864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:14.097360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:14.097783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:14.098464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:14.098914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:14.099334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:14.228752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:14.237473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5865a9a5-c555-4ec7-bbb0-f1392360ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151498 Nov 02 03:58:14.238034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1125/2255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:15.261578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:15.262184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:15.269559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:15.270035 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:15.270468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:15.271144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:15.271594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:15.272036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:15.399921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:15.408358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-231c6941-852c-4dfe-9631-dfc54611c034 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.150797 Nov 02 03:58:15.408930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1131/2256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:16.430656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:16.431273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:16.438411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:16.438889 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:16.439325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:16.440036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:16.440489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:16.440911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:16.570236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:16.580119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4c39d15f-af12-492b-829a-6d4e8e120533 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.153305 Nov 02 03:58:16.580679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1126/2257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:17.603927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:17.605165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:17.611601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:17.612127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:17.612571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:17.613264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:17.613724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:17.614174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:17.739488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:17.748290 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c56097f9-187b-46b6-845e-2d828a614876 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148177 Nov 02 03:58:17.748855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1132/2258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:18.771907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:18.772539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:18.778996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:18.779500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:18.779931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:18.781132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:18.782306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:18.782306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:18.909402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:18.917626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-049a11c8-a8f2-46ca-a5dd-2b51223e3539 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149614 Nov 02 03:58:18.918175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1127/2259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:19.942635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:19.943187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:19.949626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:19.950740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:19.951176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:19.951860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:19.952330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:19.952752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:20.076873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:20.084844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f7a56c94-4ff4-4a20-8c13-b9477bc42820 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146133 Nov 02 03:58:20.085403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1133/2260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:21.108545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:21.109182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:21.115504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:21.115992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:21.116425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:21.117098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:21.117541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:21.117957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:21.242228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:21.250800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8c6814b6-e0d7-4914-a9dd-edf0d35b9a54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146850 Nov 02 03:58:21.251360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1128/2261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:22.273682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:22.274296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:22.280867 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:22.281345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:22.281779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:22.282461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:22.282931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:22.283349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:22.413152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:22.421783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2eb9f28c-6a89-4eb5-8764-5e9060e6207d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151909 Nov 02 03:58:22.422343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1134/2262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:23.445554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:23.446167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:23.453767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:23.454318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:23.454900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:23.455664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:23.456147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:23.456635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:23.582900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:23.591009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5a73a030-db7f-4f43-bb82-76cf22c7aa81 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149429 Nov 02 03:58:23.591561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1129/2263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:58:24.614103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:24.614711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:24.621080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:24.621554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:24.621986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:24.622662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:24.623110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:24.623528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:24.749800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:24.757860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb7b6804-604d-4862-8544-033f68caed0e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147613 Nov 02 03:58:24.758414 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1135/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:25.782152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:25.782706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:25.788820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:25.789293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:25.789721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:25.790400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:25.790842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:25.791286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:25.914270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:25.922989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-246dff45-2706-4fdd-8786-7cc1ddd82beb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145384 Nov 02 03:58:25.923541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1130/2265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:26.946203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:26.946813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:26.953139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:26.953629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:26.954046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:26.954721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:26.955168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:26.955616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:27.079816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:27.088884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-db81f63d-9321-492f-8cfd-75bdaebeb6ed tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146421 Nov 02 03:58:27.089509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1136/2266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:28.112965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:28.113579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:28.119884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:28.120393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:28.120826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:28.121508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:28.122005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:28.122426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:28.249856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:28.257937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c932fa5-97a3-431e-9ae9-feb796d8af82 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148826 Nov 02 03:58:28.258493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1131/2267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:29.282049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:29.282668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:29.284520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=26 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:29.289488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:29.289970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:29.290408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:29.291094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:29.291544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:29.291987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:29.295410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=78 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:29.417503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:29.426109 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-28a0dc5f-d545-40ae-92e6-80bb6d5dafcd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148027 Nov 02 03:58:29.426672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1137/2268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:30.449282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:30.450464 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:30.452827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=26 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:30.458109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:30.458584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:30.459020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:30.459703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:30.460192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:30.460615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:30.464493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=78 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:30.591108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:30.599223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e5ec115-76e5-4c60-a3bb-d341ceba4d26 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.153782 Nov 02 03:58:30.599781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1132/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:31.622349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:31.622953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:31.629666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:31.630141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:31.630572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:31.631251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:31.631698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:31.632143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:31.756857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:31.764882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-337ceafe-dad2-45b7-b43f-98d359a8784b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146470 Nov 02 03:58:31.765438 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1138/2270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:32.788684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:32.789305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:32.796221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:32.796702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:32.797138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:32.797819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:32.798270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:32.798692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:32.928392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:32.937140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc57639b-cf35-4005-a68e-d1e129993be8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152373 Nov 02 03:58:32.937694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1133/2271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:33.960381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:33.961036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:33.967372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:33.967851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:33.968316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:33.969000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:33.969453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:33.969882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:34.094705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:34.102841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d677d42e-820d-4e60-9dc5-afb3078efe1b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146370 Nov 02 03:58:34.103399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1139/2272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:35.126297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:35.126843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:35.133173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:35.133656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:35.134091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:35.134771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:35.135225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:35.135648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:35.259286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:35.268061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e1d48c12-8be9-484c-b754-ffbd87f74c66 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.145937 Nov 02 03:58:35.268646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1134/2273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:36.294049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:36.294653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:36.301013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:36.301491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:36.301925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:36.302641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:36.303093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:36.303517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:36.430165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:36.438323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-04291e08-9398-4740-90e4-18c2e23d39b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148946 Nov 02 03:58:36.438882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1140/2274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:37.461728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:37.462354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:37.469409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:37.469892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:37.470332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:37.471018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:37.471471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:37.471901 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:37.601132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:37.609247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-adb2521a-1c9e-415f-a748-75153cea4ca1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151366 Nov 02 03:58:37.609805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1135/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:38.633809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:38.634363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:38.641427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:38.641903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:38.642339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:38.643025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:38.643478 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:38.643905 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:38.773498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:38.782785 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9166490f-6187-436d-a995-5621a461571a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.152935 Nov 02 03:58:38.783348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1141/2276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:39.806606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:39.807167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:39.814091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:39.814567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:39.815003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:39.815682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:39.816169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:39.816595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:39.940982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:39.949112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e9ace69b-ab45-463e-9d26-f69293d4a537 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146551 Nov 02 03:58:39.949673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1136/2277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:40.972231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:40.972846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:40.979334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:40.979825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:40.980298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:40.981103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:40.981942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:40.982726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:41.263750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:41.271829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6911aa14-4aa9-4437-bf5a-abb796f6449f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.303473 Nov 02 03:58:41.272418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1142/2278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:42.295248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:42.295867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:42.302395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:42.302871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:42.303302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:42.303998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:42.304451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:42.304876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:42.432800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:42.440854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-20c05871-b796-4333-8d50-484afdd6dd2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.150073 Nov 02 03:58:42.441407 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1137/2279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:43.464089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:43.464698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:43.472214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:43.472694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:43.473125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:43.473803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:43.474249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:43.474864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:43.600046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:43.608196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-818a7374-9e50-4b20-8eef-97406eaea944 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148472 Nov 02 03:58:43.608745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1143/2280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:44.631196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:44.631805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:44.638228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:44.638701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:44.639132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:44.639802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:44.640275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:44.640692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:44.770507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:44.779228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c2959a5-282f-43cb-830c-23448bb79ee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.151848 Nov 02 03:58:44.779828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1138/2281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:45.802190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:45.802778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:45.810775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:45.811285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:45.812083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:45.813033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:45.813484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:45.813909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:45.942723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:45.952611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7397bb1c-5ecb-42a2-bf30-0d51e6fa3251 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.154175 Nov 02 03:58:45.953180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1144/2282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:46.975965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:46.976598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:46.978985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:58:46.979132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 03:58:46.984944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:46.985421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:46.985853 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:46.986533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:46.987093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:46.987394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:47.121549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:47.130006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8e04cd12-a68c-4b44-8e0c-1485eb605dbf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.157925 Nov 02 03:58:47.130568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1139/2283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:48.154014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:48.154610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:48.160923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:48.161401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:48.161834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:48.162511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:48.162962 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:48.163386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:48.286075 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:48.294100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-216d0062-20c7-4ee2-9998-9c5a916a352f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.143890 Nov 02 03:58:48.294649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1145/2284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:49.317786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:49.318423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:49.325273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:49.325749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:49.326182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:49.326864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:49.327312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:49.327735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:49.452008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:49.460182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cd934b1e-7c44-44a3-b746-6c44bc164a2e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.146309 Nov 02 03:58:49.460743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1140/2285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:50.484320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:50.484935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:50.491277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:50.491753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:50.492278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:50.492958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:50.493406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:50.493824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:50.620783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:50.629021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7d958f30-5ca5-422b-8a2f-32fa0534e085 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149111 Nov 02 03:58:50.629565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1146/2286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:51.652619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:51.653159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:51.659527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:51.660039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:51.660473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:51.661149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:51.661595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:51.662016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:51.786810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:51.795397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7225c668-825e-4062-a82d-04f617d486b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.147072 Nov 02 03:58:51.795975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1141/2287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:52.819013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:52.819629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:52.822034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:58:52.822179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 03:58:52.828851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:52.829329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:52.829764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:52.830442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:52.830895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:52.831316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:52.963879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:52.972662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aa6a479a-973d-4556-86cb-ffdec7ba301c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.157447 Nov 02 03:58:52.973216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1147/2288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:53.994951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:53.996876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:53.999605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:58:53.999905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 03:58:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 03:58:54.007393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:54.007874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:54.008327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:54.009019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:54.009465 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:54.009884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:54.144730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:54.153492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-60498b1a-37db-4c0b-a3ee-72f4c2117728 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.162651 Nov 02 03:58:54.154128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1142/2289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:55.177154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:55.177714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:55.184723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:55.185212 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:55.185654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:55.186346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:55.186807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:55.187238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:55.313934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:55.322170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-681ef87f-d140-437e-bb0e-f7612fcdbe25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148948 Nov 02 03:58:55.322723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1148/2290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:56.344703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:56.345311 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:56.351641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:56.352149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:56.352583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:56.353257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:56.353700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:56.354118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:56.481068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:56.489154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6e0031d3-5e39-40fd-93ef-14ab86c4ab3c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.148233 Nov 02 03:58:56.489758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1143/2291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:57.513430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:57.514303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:57.520387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:57.520866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:57.521300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:57.521977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:57.522426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:57.522847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:57.649568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:57.658773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cfd84262-3f04-4ec7-99fc-708c16bcdb2b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.149189 Nov 02 03:58:57.659336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1149/2292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:58.682759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:58.683882 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:58.690480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:58.690994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:58.691434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:58.692200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:58.692655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:58.693076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:58.838732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:58:58.847994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2ab169cd-cd53-4e67-9562-887e3c686462 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1719 microversion: 2.1 time: 0.169235 Nov 02 03:58:58.848742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1144/2293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:58:59.871724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:58:59.872719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:58:59.875858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 03:58:59.876033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 03:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 03:58:59.876904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=26 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:59.877602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68620f31-6b17-41c5-9c0f-48ac66097f04", "name": "network-vif-deleted", "tag": "eb29890c-297b-42ed-a158-d316f359bc7c"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 03:58:59.889291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:59.889816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:59.890553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:59.903096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:59.903610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:59.904095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:59.904891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] Creating event network-vif-deleted:eb29890c-297b-42ed-a158-d316f359bc7c for instance 68620f31-6b17-41c5-9c0f-48ac66097f04 on hv-cinder-86020 Nov 02 03:58:59.905031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:58:59.905445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:58:59.906960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:58:59.911071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-499961d4-e7d2-4f99-9094-8abdf351ae83 req-33b9152e-4276-4035-8d19-f02692e1df85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037442 Nov 02 03:58:59.912229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1145/2294] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 03:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 03:58:59.940348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=78 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:58:59.993317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:00.006277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2d5e42b8-8f34-43d8-baaf-66176e08cc14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1652 microversion: 2.1 time: 0.138445 Nov 02 03:59:00.007257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1150/2295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:58:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1652 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:01.034974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:01.035672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:01.037622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:01.043520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:01.044025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:01.044462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:01.045155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:01.046185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:01.046185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:01.050171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=80 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:01.111221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:01.121267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-327e37eb-9210-43ea-b6f8-5401f599e9b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.090891 Nov 02 03:59:01.121835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1146/2296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:02.144411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:02.145062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:02.151448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:02.151932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:02.152404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:02.153095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:02.153554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:02.153982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:02.214865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:02.223042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ad3b6a72-b32e-45a9-89f8-577b2100fb6c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082561 Nov 02 03:59:02.223597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1151/2297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:03.246207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:03.246827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:03.253652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:03.254136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:03.254578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:03.255264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:03.255720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:03.256181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:03.316098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:03.324428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a6f847d7-c969-4f36-85bc-019d10c36c28 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081962 Nov 02 03:59:03.324995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1147/2298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:04.347033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:04.347643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:04.354099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:04.354576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:04.355007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:04.355684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:04.356161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:04.356586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:04.416640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:04.424636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21c0ca14-e894-4c7f-a328-63d15571e4c5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081477 Nov 02 03:59:04.425188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1152/2299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:05.446808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:05.447420 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:05.454394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:05.454870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:05.455305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:05.455996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:05.456444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:05.456864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:05.518782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:05.526921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3fcf373c-6272-46eb-93ab-bbb2020c59b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083911 Nov 02 03:59:05.527489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1148/2300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:06.549963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:06.550580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:06.557100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:06.557590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:06.558031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:06.559369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:06.559828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:06.560300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:06.622932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:06.631337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-02a1c4ad-fb25-4db3-96e7-a687414148dd tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085252 Nov 02 03:59:06.631898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1153/2301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:07.654089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:07.654696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:07.661361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:07.661835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:07.662267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:07.662945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:07.663388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:07.663805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:07.723655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:07.731896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6b6d4b12-bd0d-468e-820e-6f458fb3945d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081851 Nov 02 03:59:07.732480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1149/2302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:08.754770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:08.755386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:08.761825 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:08.762308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:08.762769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:08.763455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:08.763907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:08.764358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:08.825468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:08.833572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1a89036d-098e-4fea-82b7-0270c927abc0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082614 Nov 02 03:59:08.834129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1154/2303] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:09.856936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:09.857551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:09.864081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:09.864561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:09.864997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:09.865679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:09.866128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:09.866554 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:09.928986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:09.937084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e02ba62a-25c2-4d16-babb-4887395d0315 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084671 Nov 02 03:59:09.937644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1150/2304] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:10.958713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:10.959325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:10.965955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:10.966431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:10.966865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:10.967544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:10.968012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:10.968436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:11.243078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:11.252245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f6d061db-141e-4367-ae3b-33f1d9428025 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.297330 Nov 02 03:59:11.252800 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1155/2305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:12.274731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:12.275341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:12.282187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:12.282664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:12.283097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:12.283777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:12.284256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:12.284682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:12.346288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:12.354411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c546a327-731b-442e-bf68-bdb8d9426108 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083526 Nov 02 03:59:12.354977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1151/2306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:13.378330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:13.378929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:13.385385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:13.385975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:13.386429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:13.387113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:13.387570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:13.388025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:13.446818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:13.454896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8c360d51-e8c2-44f4-bb48-620600957fa8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080737 Nov 02 03:59:13.455447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1156/2307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:14.477495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:14.478131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:14.484476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:14.484957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:14.485392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:14.486072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:14.486558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:14.486982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:14.547662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:14.555854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-925f4d40-0efb-462a-8407-c1f8df19cbaa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082179 Nov 02 03:59:14.556428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1152/2308] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:15.578861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:15.579503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:15.585921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:15.586399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:15.586833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:15.587516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:15.587982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:15.588413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:15.649918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:15.657866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5e5b54fb-5f7f-44d0-b21b-9f60a7c536a3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082853 Nov 02 03:59:15.658413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1157/2309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:16.680781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:16.681411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:16.688362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:16.688830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:16.689261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:16.689927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:16.690370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:16.690787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:16.750502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:16.758482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-43804553-4b6d-4209-8f5a-336d706a2b59 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081592 Nov 02 03:59:16.759039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1153/2310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:17.782507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:17.783074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:17.789670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:17.790160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:17.790606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:17.791309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:17.791770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:17.792227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:17.851750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:17.859870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a65e1cfc-db1f-4df6-be01-2a1939624c78 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081364 Nov 02 03:59:17.860453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1158/2311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:18.883076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:18.883695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:18.890196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:18.890672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:18.891110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:18.891792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:18.892266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:18.892699 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:18.952101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:18.960186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8df135c4-03ca-4bca-b6bc-cd5defabfd5f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080899 Nov 02 03:59:18.960746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1154/2312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:19.983160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:19.983774 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:19.990231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:19.990712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:19.991152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:19.991839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:19.992318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:19.992744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:20.055897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:20.064587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6c852e81-56bd-457a-bd92-de602a450b01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085814 Nov 02 03:59:20.065158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1159/2313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:21.086793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:21.087337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:21.093664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:21.094140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:21.094577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:21.095258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:21.095707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:21.096163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:21.156163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:21.164247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c6e79937-0d4d-4295-bec7-ca94a176240f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081382 Nov 02 03:59:21.164811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1155/2314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:22.188838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:22.189448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:22.195844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:22.196346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:22.196780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:22.197459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:22.197909 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:22.198333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:22.260432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:22.268955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b34388e4-5e76-40dc-bd37-e1e1f081edb0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084006 Nov 02 03:59:22.269499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1160/2315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:23.292197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:23.293372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:23.299768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:23.300273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:23.300705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:23.301384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:23.301832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:23.302254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:23.362649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:23.370734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c26452d8-dc5d-4014-a8c0-08010c9d575b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082502 Nov 02 03:59:23.371290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1156/2316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:24.393562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:24.394182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:24.400769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:24.401263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:24.401692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:24.402386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:24.403403 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:24.403865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:24.621458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:24.629930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a2b608f5-f54a-47ee-9c05-dd1961cb860a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.240278 Nov 02 03:59:24.630479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1161/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:25.653409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:25.653955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:25.659793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:25.660295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:25.660722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:25.661394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:25.661844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:25.662261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:25.724655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:25.732716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-93085eb7-8c3a-4b94-8657-56db826e510b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083904 Nov 02 03:59:25.733270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1157/2318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:26.755925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:26.756600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:26.762901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:26.763382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:26.763816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:26.764532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:26.764983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:26.765409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:26.824885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:26.832992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b91d2c64-bee6-4b84-88bc-7581bed22d52 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080897 Nov 02 03:59:26.833548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1162/2319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:27.855630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:27.856237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:27.862659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:27.863135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:27.863563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:27.864259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:27.864703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:27.865119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:27.924160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:27.932250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7dafadfa-d12f-483a-8bef-6cc0a02d09b8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080430 Nov 02 03:59:27.932831 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1158/2320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:28.955354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:28.956010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:28.962350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:28.962831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:28.963289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:28.964009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:28.964465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:28.964890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:29.026581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:29.034596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f4c8117-d870-4540-bb5d-a8934cf16438 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083215 Nov 02 03:59:29.035150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1163/2321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:30.057462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:30.058071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:30.065096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:30.065573 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:30.066004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:30.066679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:30.067125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:30.067545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:30.128580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:30.136549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-02e68b62-cdbc-471f-8cf2-26f8e796bb01 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083014 Nov 02 03:59:30.137785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1159/2322] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:31.159768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:31.160323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:31.162609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:31.169006 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:31.169514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:31.169952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:31.170635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:31.171086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:31.171508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:31.174153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:31.232534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:31.240587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f8affeee-8bd3-4751-8dbb-b67b986b1b5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084761 Nov 02 03:59:31.241148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1164/2323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:32.262644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:32.263258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:32.265568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:32.270836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:32.271319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:32.271777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:32.272483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:32.272931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:32.273347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:32.277986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:59:32.333534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:32.342161 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4c6c55a1-6d44-4e61-b7e4-db13f1c6870e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083402 Nov 02 03:59:32.342713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1160/2324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:33.365259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:33.365879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:33.372349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:33.372831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:33.374525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:33.375225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:33.375681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:33.376147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:33.438047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:33.446102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d91fcd26-e4c2-4f58-87fc-2e2dbd0edfe0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084797 Nov 02 03:59:33.446683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1165/2325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:34.468727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:34.469319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:34.475694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:34.476196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:34.476628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:34.477301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:34.477746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:34.478163 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:34.538229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:34.546462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e0fe4ce-9142-4906-9781-e8b52cb2d6d6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082098 Nov 02 03:59:34.547021 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1161/2326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:35.569698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:35.570312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:35.576694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:35.577170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:35.577610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:35.578287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:35.578739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:35.579160 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:35.639099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:35.647203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1ebac423-8acc-4baa-b38e-38f732cef247 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081385 Nov 02 03:59:35.647747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1166/2327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:36.671182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:36.671791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:36.678189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:36.678665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:36.679093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:36.679771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:36.680238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:36.680657 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:36.740206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:36.748776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c9ebb0e8-b86c-4aaf-bf91-a2c627b87af5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082064 Nov 02 03:59:36.749578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1162/2328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:37.770445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:37.771055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:37.777394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:37.777869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:37.778300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:37.779721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:37.780198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:37.780618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:37.845262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:37.853386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-133a293e-c2fb-475f-b9e1-74b4462513e6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086795 Nov 02 03:59:37.853944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1167/2329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:38.875731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:38.876371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:38.882940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:38.883421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:38.883860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:38.884578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:38.885042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:38.885467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:38.945187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:38.953321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-969bc8d8-891e-47e4-8164-21421fb2b687 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081686 Nov 02 03:59:38.953892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1163/2330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:39.975893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:39.976542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:39.982998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:39.983477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:39.983964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:39.984654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:39.985110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:39.985537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:40.045577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:40.053599 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d529e06e-6030-41db-adaf-5acf2031a38b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081534 Nov 02 03:59:40.054154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1168/2331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:41.077081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:41.077610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:41.083912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:41.084480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:41.084915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:41.085600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:41.086049 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:41.086468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:41.148574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:41.157146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-545046dc-f99e-41a8-90c1-64039ab93e2a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084056 Nov 02 03:59:41.157701 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1164/2332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:42.180492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:42.181104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:42.187549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:42.188051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:42.188488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:42.189170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:42.189619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:42.190047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:42.252386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:42.260416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0a018176-1066-4800-8c70-d851bec6d39a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083734 Nov 02 03:59:42.260963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1169/2333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:43.283368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:43.283995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:43.290391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:43.290868 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:43.291300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:43.292002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:43.292455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:43.292881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:43.354519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:43.362670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f160b10e-1062-4097-b619-bdc425cc9e61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083176 Nov 02 03:59:43.363229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1165/2334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:44.385949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:44.386585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:44.393431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:44.393937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:44.394364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:44.395040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:44.395488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:44.395914 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:44.455935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:44.463973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f8eea374-7e39-4d78-a961-7286fe6afd0a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081876 Nov 02 03:59:44.464518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1170/2335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:45.489170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:45.490318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:45.497243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:45.497718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:45.498148 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:45.498829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:45.499512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:45.499935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:45.564165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:45.572343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bbcfa4f4-40e3-4cb7-b7a1-565e30946278 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.088507 Nov 02 03:59:45.572899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1166/2336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:46.596500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:46.597128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:46.604375 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:46.604859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:46.605299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:46.606000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:46.606460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:46.607073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:46.670260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:46.678364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-846f6109-5461-4882-abf5-b2c1be4b9450 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086427 Nov 02 03:59:46.678923 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1171/2337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:47.700769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:47.701385 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:47.708329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:47.708808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:47.709242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:47.709918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:47.710366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:47.710788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:47.770419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:47.778546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b818cc21-c0a3-4710-bfe1-3c8b09b6e98e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081570 Nov 02 03:59:47.779437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1167/2338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:48.800870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:48.801407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:48.807848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:48.808357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:48.808796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:48.809481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:48.809935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:48.810363 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:48.870537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:48.879533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6488b3c0-67ea-4b9b-99e4-c0b3fe7c18b1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082585 Nov 02 03:59:48.880112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1172/2339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:49.902018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:49.902582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:49.909680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:49.910149 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:49.910578 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:49.911254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:49.911700 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:49.912158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:49.972694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:49.980837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0e48f063-e024-45be-9560-8346710ddb21 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082730 Nov 02 03:59:49.981395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1168/2340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:51.003941 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:51.004615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:51.011110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:51.011592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:51.012059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:51.012752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:51.013210 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:51.013639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:51.079697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:51.087852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f751f453-8b8c-45fe-a6c0-0f19c0e6daee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.087795 Nov 02 03:59:51.088431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1173/2341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:52.110496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:52.111133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:52.117424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:52.117897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:52.118326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:52.118997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:52.119439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:52.119861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:52.179577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:52.188207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bd505036-f0d1-4782-899a-f3fc4f8e7492 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081516 Nov 02 03:59:52.188757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1169/2342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:53.210590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:53.211205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:53.218098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:53.218577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:53.219023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:53.219708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:53.220191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:53.220615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:53.281672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:53.289902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-29bb56da-99b0-43b6-b18d-47368141228e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083198 Nov 02 03:59:53.290467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1174/2343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:54.314434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:54.315043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:54.321922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:54.322400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:54.322835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:54.323527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:54.323993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:54.324601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:54.387787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:54.396344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58d0e980-0956-4a4e-b956-22298ac9cd9f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.087677 Nov 02 03:59:54.396903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1170/2344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:55.419398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:55.420082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:55.426481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:55.426967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:55.427406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:55.428128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:55.428587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:55.429012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:55.491163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:55.500089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-274c35f4-201b-4c64-82b5-0c5025a51da6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084495 Nov 02 03:59:55.500676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1175/2345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 03:59:56.634139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:56.634746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:56.641386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:56.641857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:56.642287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:56.642956 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:56.643401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:56.643984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:56.705051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:56.712954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-630dc64d-660f-4778-8612-241f6f05c338 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.194160 Nov 02 03:59:56.713510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1171/2346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:57.736709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:57.737322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:57.743700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:57.744209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:57.744645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:57.745322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:57.745772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:57.746192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:57.806364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:57.815101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-feeb0a97-6c9f-44cd-892c-305683dc3c54 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082210 Nov 02 03:59:57.815651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1176/2347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:58.837625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:58.838240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:58.845216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:58.845694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:58.846127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:58.846810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:58.847264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:58.847687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:58.907717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 03:59:58.915779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3790b9bb-4af2-41f4-be3d-60c915e4d6e0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082018 Nov 02 03:59:58.916360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1172/2348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 03:59:59.938379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 03:59:59.938918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 03:59:59.945246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:59.945723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:59.946155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 03:59:59.946834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 03:59:59.947282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 03:59:59.947704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:00.011372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:00.020318 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a23c8712-9a95-4837-aadd-a7e14e304111 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085811 Nov 02 04:00:00.020876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1177/2349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 03:59:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:01.042906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:01.043604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:01.051529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:01.052144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:01.052651 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:01.053460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:01.053975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:01.054405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:01.131839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:01.140206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c7990679-458f-4964-a200-989c50a6fe60 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.101372 Nov 02 04:00:01.140996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1173/2350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:02.165550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:02.165550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:02.167400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:02.172654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:02.173150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:02.173598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:02.174298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:02.174755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:02.175235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:02.179362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:02.238929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:02.247427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a410fbec-8226-45bd-ad55-969632fa4ac6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.087034 Nov 02 04:00:02.248554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1178/2351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:03.273067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:03.273689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:03.276409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:03.282350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:03.282835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:03.283275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:03.283981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:03.284442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:03.284870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:03.287560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:03.346364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:03.354555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c07145c4-2cc2-4645-912f-17283da9d593 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086311 Nov 02 04:00:03.355118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1174/2352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:04.378095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:04.378709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:04.385102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:04.385577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:04.386012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:04.386691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:04.387141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:04.387562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:04.449656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:04.458540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-90d000c9-223f-496f-ad7d-bcb3c198d213 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085051 Nov 02 04:00:04.459091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1179/2353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:05.480386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:05.481140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:05.487537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:05.488046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:05.488488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:05.489169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:05.489621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:05.490040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:05.550642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:05.558830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6afb9a02-3840-4222-a009-6fa97c384633 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082288 Nov 02 04:00:05.559391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1175/2354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:06.581423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:06.582031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:06.588629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:06.589112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:06.589548 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:06.590236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:06.590699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:06.591126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:06.653208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:06.661691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7f65348d-7e28-43da-9659-83351cfdde38 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084132 Nov 02 04:00:06.662250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1180/2355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:07.684507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:07.685112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:07.692036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:07.692512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:07.692945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:07.693620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:07.694065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:07.694485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:07.754155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:07.762374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c72fdfda-bf8b-42e4-8776-66b51bc2d648 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081675 Nov 02 04:00:07.762961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1176/2356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:08.785256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:08.785794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:08.792345 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:08.792826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:08.793265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:08.793950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:08.794436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:08.794862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:08.857821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:08.865986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-47dd5cec-c4e5-45f3-856f-9e06c02065f6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084646 Nov 02 04:00:08.866547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1181/2357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:09.889880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:09.890430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:09.896834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:09.897315 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:09.897757 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:09.898450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:09.898904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:09.899327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:09.960948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:09.969629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-88aa3de3-6a46-4e6f-a130-097cd0ef6fe6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084174 Nov 02 04:00:09.970387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1177/2358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:10.992051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:10.992671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:10.999787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:11.000297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:11.000750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:11.001448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:11.001901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:11.002329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:11.062521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:11.070644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2531d59-0a7a-4e69-8a7c-16ea71c0f5a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082473 Nov 02 04:00:11.071202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1182/2359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:12.095294 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:12.095827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:12.102197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:12.102674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:12.103111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:12.103786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:12.104258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:12.104684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:12.165297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:12.173412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a03023c3-04b3-4af2-9f7b-bf106af7231f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082755 Nov 02 04:00:12.173973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1178/2360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:13.195958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:13.196513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:13.202908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:13.203390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:13.203826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:13.204554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:13.205010 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:13.205440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:13.268250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:13.276412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71e7f7d6-6b7a-4d0a-8683-2977fc728c65 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084378 Nov 02 04:00:13.276967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1183/2361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:14.300254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:14.300902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:14.307885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:14.308394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:14.308824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:14.309494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:14.309940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:14.310356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:14.370443 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:14.379349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-43591527-26fb-4cfd-b63a-a6b16e16ca3d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082990 Nov 02 04:00:14.379907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1179/2362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:15.402074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:15.402676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:15.409151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:15.409632 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:15.410072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:15.410792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:15.411251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:15.411695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:15.472446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:15.480569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3fc85fb1-113c-4b88-a30d-d5ed05543c02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082466 Nov 02 04:00:15.481133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1184/2363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:16.504142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:16.504758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:16.511179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:16.511663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:16.512134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:16.512830 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:16.513289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:16.513716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:16.574387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:16.582449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4f83b3a3-6a98-4193-af47-a8b6d33f2fcb tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082230 Nov 02 04:00:16.583038 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1180/2364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:17.604542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:17.605186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:17.611656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:17.612169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:17.612607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:17.613293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:17.613747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:17.614175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:17.676782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:17.684930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4ad42fe0-d9d7-404c-8307-be18e23ec58a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084217 Nov 02 04:00:17.685493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1185/2365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:18.708453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:18.709061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:18.715359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:18.715833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:18.716298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:18.716970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:18.717466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:18.717886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:18.778034 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:18.786125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-90dfc056-7d08-4094-b734-f1de053c48ff tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081550 Nov 02 04:00:18.786626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1181/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:19.808528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:19.809069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:19.815457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:19.815939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:19.816400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:19.817095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:19.817550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:19.817977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:19.881065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:19.889817 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2c9a7ce2-9108-45e5-b4ce-b037ffbb07a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084582 Nov 02 04:00:19.890380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1186/2367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:20.912219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:20.912828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:20.919228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:20.919697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:20.920164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:20.920845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:20.921287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:20.921703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:20.981047 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:20.989782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e305df48-693b-4847-94d3-7fb4ccee8724 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081374 Nov 02 04:00:20.990334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1182/2368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:22.013392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:22.014042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:22.020420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:22.020897 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:22.021332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:22.022011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:22.022463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:22.022920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:22.087364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:22.095500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-53e786aa-9908-41d9-b85d-61bac0653666 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085931 Nov 02 04:00:22.096091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1187/2369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:23.118547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:23.119104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:23.125807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:23.126281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:23.126720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:23.127390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:23.127841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:23.128283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:23.190441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:23.198523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d66c350d-ef30-48b6-93ec-bf1f2991e744 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083946 Nov 02 04:00:23.199078 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1183/2370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:24.221145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:24.221763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:24.228226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:24.228711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:24.229254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:24.230015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:24.230313 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:24.230844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:24.293312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:24.301007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-49cf8869-579b-4455-88a3-98ea703444b0 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083716 Nov 02 04:00:24.301577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1188/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:25.326020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:25.326631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:25.332996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:25.333469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:25.333898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:25.334570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:25.335030 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:25.335429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:25.397276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:25.405261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-32a92bfa-1d5a-4a28-88b2-0e76ab7088b9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083555 Nov 02 04:00:25.405813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1184/2372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:26.428826 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:26.429441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:26.435811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:26.436331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:26.436770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:26.437656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:26.438410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:26.439062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:26.503444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:26.511596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8e5429b2-15e0-4edb-b1bc-ae31382b4966 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086631 Nov 02 04:00:26.512196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1189/2373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:27.534303 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:27.534942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:27.541665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:27.542141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:27.542584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:27.543267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:27.543719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:27.544172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:27.604237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:27.612848 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b7b1d551-aabe-482d-8ba0-8155ad3917ef tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082530 Nov 02 04:00:27.613408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1185/2374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:28.636564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:28.637193 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:28.643221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:28.643689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:28.644169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:28.644849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:28.645297 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:28.645716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:28.705360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:28.713370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb499c11-627d-467a-8339-5510a4f07925 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080768 Nov 02 04:00:28.713920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1190/2375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:29.737072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:29.737684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:29.744091 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:29.744570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:29.745003 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:29.745681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:29.746131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:29.746550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:29.806695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:29.815430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cb4e5e5e-bc5f-42ef-9ca1-9f58ff8501be tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082686 Nov 02 04:00:29.816638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1186/2376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:30.839762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:30.840373 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:30.846726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:30.847209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:30.847645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:30.848354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:30.848809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:30.849230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:30.912205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:30.920205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5ba3172d-c11f-4989-953b-740cf50c7c55 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084339 Nov 02 04:00:30.920763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1191/2377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:31.943444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:31.944031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:31.950297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:31.950776 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:31.951206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:31.951877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:31.952352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:31.953277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:32.013866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:32.022387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d08d2636-3476-47e6-9b54-acf9a4d9f14b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082863 Nov 02 04:00:32.022940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1187/2378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:33.045710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:33.046319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:33.048924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:33.054083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:33.054556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:33.054990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:33.055669 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:33.056152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:33.056576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:33.059213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:33.117341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:33.126140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-abefad3c-eefb-4e6a-a3e0-123f799c953b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084293 Nov 02 04:00:33.126696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1192/2379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:34.149447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:34.150068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:34.152766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:34.158637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:34.159122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:34.159560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:34.160277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:34.160729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:34.161155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:34.163828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:00:34.222319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:34.230387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-82314440-fbe2-440d-90f2-62cfae881d61 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084862 Nov 02 04:00:34.230941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1188/2380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:35.253741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:35.254358 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:35.260901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:35.261386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:35.261830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:35.262521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:35.262976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:35.263405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:35.330135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:35.338303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bfda8c73-d312-4873-9698-2aa507535d22 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.089224 Nov 02 04:00:35.338862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1193/2381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:36.361528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:36.362142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:36.368628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:36.369111 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:36.369575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:36.370262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:36.370716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:36.371142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:36.431324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:36.439360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e65ecc65-2800-4d76-bfcd-f189827d32da tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081799 Nov 02 04:00:36.439922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1189/2382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:37.462581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:37.463198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:37.470169 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:37.470656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:37.471099 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:37.471791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:37.472279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:37.472766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:37.533779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:37.542038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-136f1960-4cb5-4b74-a16a-81c763eae8b5 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083339 Nov 02 04:00:37.542589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1194/2383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:38.565942 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:38.566551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:38.572936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:38.573405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:38.573835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:38.574508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:38.574952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:38.575368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:38.638051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:38.646224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c92eedce-35e9-41bb-ba19-cd1342e1596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084660 Nov 02 04:00:38.646774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1190/2384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:39.668770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:39.669405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:39.676347 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:39.676829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:39.677262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:39.677942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:39.678392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:39.678815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:39.742089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:39.750416 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fccd6fb3-f24d-4323-b864-a9f6d3ef344e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085474 Nov 02 04:00:39.750972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1195/2385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:40.772878 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:40.773493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:40.779900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:40.780360 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:40.780801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:40.781490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:40.781943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:40.782370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:40.842623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:40.850766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-caccd306-2bc4-4c16-a4f9-62126f4e0f41 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081827 Nov 02 04:00:40.851323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1191/2386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:00:41.872884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:41.873504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:41.881174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:41.881768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:41.882206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:41.882891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:41.883350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:41.883775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:41.944277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:41.952204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3bfdf637-d540-43fb-8fba-125c7781ab44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083166 Nov 02 04:00:41.952788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1196/2387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:42.974326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:42.974941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:42.981434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:42.981914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:42.982350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:42.983042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:42.983493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:42.984485 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:43.044253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:43.053002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-21058821-0354-452c-913f-7336cad96330 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082577 Nov 02 04:00:43.053557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1192/2388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:44.074989 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:44.075601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:44.082436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:44.082912 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:44.083344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:44.084042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:44.084495 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:44.084920 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:44.147702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:44.156799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5c8ff499-55f9-4ce1-8512-3f264c6aa82f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085682 Nov 02 04:00:44.157352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1197/2389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:45.179010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:45.179536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:45.186017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:45.186498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:45.186939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:45.187618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:45.188100 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:45.188526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:45.247871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:45.256234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-526519f5-70a6-4581-afe3-3aec45ead74a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081144 Nov 02 04:00:45.256797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1193/2390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:46.278534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:46.279128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:46.285645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:46.286121 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:46.286555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:46.287236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:46.287687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:46.288148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:46.347690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:46.355636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6518280d-59bf-4587-9ae0-6713802789df tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080986 Nov 02 04:00:46.356219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1198/2391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:47.378885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:47.379611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:47.386308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:47.386782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:47.387211 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:47.387888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:47.388369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:47.388787 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:47.451437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:47.459802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b3d29b7c-8b42-40e7-8f23-2c7eea60baf3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084788 Nov 02 04:00:47.460401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1194/2392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:48.484593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:48.485206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:48.491480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:48.491980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:48.492451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:48.493133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:48.493588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:48.494008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:48.559691 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:48.568503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ad451547-59d9-48e1-9d95-c25285613cd3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.088308 Nov 02 04:00:48.569055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1199/2393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:49.590660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:49.591304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:49.597744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:49.598223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:49.598656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:49.599333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:49.599780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:49.600226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:49.659845 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:49.667918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cf785c5a-3158-4b26-9898-77cc5b0405bf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081074 Nov 02 04:00:49.668498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1195/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:50.690429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:50.691047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:50.697493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:50.697979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:50.698420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:50.699110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:50.699570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:50.700027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:50.760311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:50.768516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b55e69a7-e7d5-49a9-a606-afbb3ad6ce9e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082520 Nov 02 04:00:50.769071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1200/2395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:51.791129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:51.791752 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:51.798591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:51.799074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:51.799513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:51.800234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:51.800690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:51.801117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:51.865208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:51.873468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1dfc6ca0-51b4-4b2d-bd41-4b14e73e4722 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086239 Nov 02 04:00:51.874584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1196/2396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:52.896718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:52.897337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:52.899264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:00:52.899399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 04:00:52.905526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:52.906003 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:52.906434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:52.907119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:52.907569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:52.908011 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:52.973514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:52.981661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-42b58ac8-f924-45b5-a6d1-57079bf18b8a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.088995 Nov 02 04:00:52.982218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1201/2397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:00:54.005539 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:54.006147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:54.011971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:54.012460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:54.012898 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:54.014457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:54.015477 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:54.015899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:54.074737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:54.083379 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9a59b79c-eda2-44f6-bad1-4b6bb2176f18 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081830 Nov 02 04:00:54.083929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1197/2398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:55.105885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:55.106424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:55.112767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:55.113250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:55.113690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:55.114378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:55.114831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:55.115254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:55.174888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:55.182870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a6b91a20-05e6-498f-9174-583ca228589b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080963 Nov 02 04:00:55.183423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1202/2399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:56.207981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:56.208597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:56.215064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:56.215550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:56.216018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:56.216714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:56.217167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:56.218121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:56.277843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:56.286531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b2b21bb6-ca69-46b0-ab2f-10e9ef44d337 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082433 Nov 02 04:00:56.287084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1198/2400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:57.309930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:57.310573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:57.316582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:57.317067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:57.317508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:57.318202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:57.318658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:57.319087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:57.383216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:57.391444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-35c093c3-662a-47e8-a6c3-c38f6bd54d06 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085566 Nov 02 04:00:57.392019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1203/2401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:58.414516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:58.415041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:58.421345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:58.421816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:58.422245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:58.422950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:58.423395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:58.423814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:58.483042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:58.491426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-87b67edf-474d-49f1-9e51-0e74df7ff329 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080829 Nov 02 04:00:58.492244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1199/2402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:00:59.515866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:00:59.517201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:00:59.523293 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:59.528496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:59.529106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:59.535964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:00:59.535964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:00:59.535964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:00:59.605519 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:00:59.618930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ad2033db-805f-4e43-8e5c-2ab1bd554519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.103433 Nov 02 04:00:59.618930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1204/2403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:00:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:00.641314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:00.641934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:00.648267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:00.648746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:00.649174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:00.649849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:00.650293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:00.650710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:00.710714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:00.719415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-66581bb2-0aad-4e58-96df-875890ac8c14 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082483 Nov 02 04:01:00.719990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1200/2404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:01.741900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:01.742513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:01.748918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:01.749653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:01.750082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:01.750761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:01.751258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:01.751692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:01.814385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:01.822456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ef55e3ec-cd4b-4249-9925-7e12dfb6cf1f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084486 Nov 02 04:01:01.823009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1205/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:02.846247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:02.846797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:02.853152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:02.853650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:02.854068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:02.854748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:02.855201 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:02.855620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:02.917826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:02.926871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ae4e66f4-2ece-4fb7-ba51-6983784573c2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085230 Nov 02 04:01:02.927430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1201/2406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:03.948687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:03.949287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:03.951475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:03.957239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:03.957720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:03.958152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:03.958833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:03.959286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:03.959708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:03.963676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:04.023415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:04.031604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-15196281-f47d-477f-9aca-af44e795cc3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086843 Nov 02 04:01:04.032185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1206/2407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:05.053888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:05.054484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:05.056771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:05.062637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:05.063112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:05.063544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:05.064257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:05.064704 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:05.065122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:05.069102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:05.125849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:05.133843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c7f231e0-19d2-4d6d-806b-970f4c111434 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083785 Nov 02 04:01:05.134396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1202/2408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:06.156369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:06.156983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:06.163370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:06.163851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:06.164321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:06.165009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:06.165469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:06.165894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:06.228966 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:06.237086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cb3762cd-622f-42bb-9ffc-6e4d9c0aed4b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084596 Nov 02 04:01:06.237647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1207/2409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:07.259276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:07.259881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:07.266858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:07.267328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:07.267758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:07.268466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:07.268914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:07.269330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:07.332225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:07.340209 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-db94e669-cadb-431d-8730-612c4757a794 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084751 Nov 02 04:01:07.340766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1203/2410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:07 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:08.362661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:08.363302 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:08.369818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:08.370294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:08.370727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:08.371407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:08.371854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:08.372299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:08.433095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:08.441661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af1bea72-46ef-4c95-bb02-2316468282c4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082904 Nov 02 04:01:08.442216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1208/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:09.464944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:09.465553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:09.472650 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:09.473134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:09.473569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:09.474250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:09.474702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:09.475126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:09.539062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:09.547284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c9fa02a-cabc-44e7-b09b-8d8b745601a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086115 Nov 02 04:01:09.547841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1204/2412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:10.569622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:10.570235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:10.576725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:10.577199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:10.577634 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:10.578346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:10.578796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:10.579217 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:10.641969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:10.650022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-28290b5c-7414-4fcb-9870-9394658c7c12 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084267 Nov 02 04:01:10.650580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1209/2413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:11.673705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:11.674322 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:11.680652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:11.681127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:11.681563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:11.682243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:11.682694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:11.683115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:11.742518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:11.751482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a662681f-fe2d-48cc-b9ea-4e1778d3505f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082455 Nov 02 04:01:11.752062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1205/2414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:12.774092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:12.774705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:12.781607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:12.782031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:12.782461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:12.783137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:12.783586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:12.784030 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:12.843876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:12.851935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d4626df5-cd52-47b1-b1fd-31dc683311d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081783 Nov 02 04:01:12.852521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1210/2415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:13.875389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:13.875933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:13.882321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:13.882804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:13.883245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:13.883937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:13.884410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:13.884836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:13.944590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:13.953171 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4fa5070e-5cea-4060-be92-74d49c744897 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082075 Nov 02 04:01:13.953733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1206/2416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:01:14.976539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:14.977158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:14.984165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:14.984649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:14.985089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:14.985804 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:14.986260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:14.986688 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:15.051472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:15.059628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5c057e3f-83b8-4a34-b110-9c0097db8614 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086990 Nov 02 04:01:15.060218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1211/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:16.082618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:16.083235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:16.089709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:16.090186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:16.090621 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:16.091302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:16.091755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:16.092204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:16.151819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:16.159920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b7dd69a7-d2fa-4e3f-a910-58af16e479c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081142 Nov 02 04:01:16.160497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1207/2418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:17.183018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:17.183602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:17.190512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:17.190985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:17.191425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:17.192138 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:17.192590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:17.193013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:17.253305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:17.261434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0dfbe68f-d48e-4ac3-9992-862858480e09 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082404 Nov 02 04:01:17.261992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1212/2419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:18.284336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:18.284946 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:18.291347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:18.291819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:18.292285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:18.292961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:18.293405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:18.293824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:18.354818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:18.362861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3f6d1ece-72d7-4e10-bdfd-fc819a75583a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082357 Nov 02 04:01:18.363419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1208/2420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:18 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:19.385060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:19.385664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:19.392251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:19.392736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:19.393172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:19.393860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:19.394314 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:19.394741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:19.458666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:19.466819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-271a5731-ca58-4526-976a-97253b176c25 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085654 Nov 02 04:01:19.467882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1213/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:20.490753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:20.491382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:20.497722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:20.498713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:20.499401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:20.500117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:20.500570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:20.500990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:20.563261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:20.571327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-efc913f6-a7f5-42f5-b570-006e6dfed99f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084420 Nov 02 04:01:20.571886 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1209/2422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:21.595192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:21.595799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:21.602208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:21.602682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:21.603111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:21.603791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:21.604275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:21.604697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:21.665526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:21.673635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9e5275f4-79f5-4ca9-8c82-bddac87e19a9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082985 Nov 02 04:01:21.674199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1214/2423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:22.695174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:22.695784 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:22.702198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:22.702672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:22.703106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:22.703782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:22.704262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:22.704686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:22.914295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:22.923976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-44138c61-2c38-48f5-ae84-2bbce62e5a1d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.232509 Nov 02 04:01:22.924732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1210/2424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:23.947309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:23.947876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:23.954252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:23.954740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:23.955183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:23.955878 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:23.956376 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:23.956806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:24.020894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:24.029049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-045f2681-762b-437a-8462-8a7f9e5ed0d3 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085757 Nov 02 04:01:24.030150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1215/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:25.052014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:25.052615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:25.058544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:25.059016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:25.059447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:25.060147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:25.061094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:25.061513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:25.120624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:25.129523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-01fd6a18-1d01-4009-8fd6-5a8ed910b1c1 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081281 Nov 02 04:01:25.130009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1211/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:26.151354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:26.152018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:26.158394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:26.158871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:26.159308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:26.160015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:26.160473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:26.160899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:26.222394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:26.230556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-dd8337fa-26a0-4a93-81f5-6263e188a52a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083043 Nov 02 04:01:26.231114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1216/2427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:27.252875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:27.253557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:27.259828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:27.260342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:27.260778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:27.261459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:27.261909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:27.262331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:27.321792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:27.330585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c1bbc708-b300-45eb-8cac-88eb1141ea70 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081877 Nov 02 04:01:27.331139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1212/2428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:28.354019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:28.354625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:28.360610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:28.361094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:28.361535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:28.362220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:28.362675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:28.363100 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:28.426448 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:28.434505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0cfe7ae5-f024-4958-91b6-66e11ed8b631 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084578 Nov 02 04:01:28.435066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1217/2429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:29.457577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:29.458184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:29.464643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:29.465122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:29.465553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:29.466236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:29.466678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:29.467097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:29.526719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:29.535354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-36815358-9600-462a-9fd0-aa4df9248707 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081116 Nov 02 04:01:29.535903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1213/2430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:29 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:30.557883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:30.558525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:30.564987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:30.565470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:30.565899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:30.566576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:30.567026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:30.567447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:30.627600 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:30.635864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e76939aa-f4e6-4757-89ce-c513c17e43e8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081860 Nov 02 04:01:30.636461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1218/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:31.659584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:31.660168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:31.666774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:31.667252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:31.667684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:31.668429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:31.668874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:31.669292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:31.729226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:31.737300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4418d07e-9b34-4714-89fe-2c7bad6c0d34 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081665 Nov 02 04:01:31.737842 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1214/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:32.760603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:32.761241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:32.768199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:32.768673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:32.769103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:32.769781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:32.770229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:32.770647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:32.833019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:32.841038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6d6cd42a-3a50-474c-aecd-246531a4b41e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084292 Nov 02 04:01:32.842244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1219/2433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:33.864339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:33.864883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:33.871125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:33.871599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:33.872052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:33.872732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:33.873175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:33.873593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:33.935849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:33.944028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fc91ce15-3745-46ed-9436-40a4b20b7e32 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083683 Nov 02 04:01:33.944589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1215/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:34.967317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:34.967935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:34.970243 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:34.975628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:34.976142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:34.976578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:34.977267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:34.977718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:34.978142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:34.980893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:35.041821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:35.050294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2e847d22-bff2-424b-b71c-7a95bb6140b2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.087497 Nov 02 04:01:35.050851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1220/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:36.072996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:36.073611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:36.075932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:36.081208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:36.081695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:36.082134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:36.082818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:36.083274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:36.083696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:36.086376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:01:36.145941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:36.154439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ef45b3ff-653c-4cb6-827e-c21f20d97ad7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084805 Nov 02 04:01:36.154989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1216/2436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:01:37.176157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:37.176699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:37.183015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:37.183497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:37.183936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:37.184656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:37.185115 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:37.185546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:37.247891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:37.256316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-71496e3f-30f7-4f8e-b0db-dd15542359a8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084106 Nov 02 04:01:37.256881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1221/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:38.279351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:38.279986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:38.286266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:38.286756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:38.287197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:38.287914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:38.288397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:38.288825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:38.349160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:38.357372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8342afcf-5073-4fe0-b1d6-2daacdf53d5b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081865 Nov 02 04:01:38.357934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1217/2438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:39.379901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:39.380550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:39.387012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:39.387511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:39.387929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:39.389140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:39.389595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:39.390022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:39.449528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:39.458116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-14e6fd4e-009e-4176-8b67-c99f6c6e2daa tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082023 Nov 02 04:01:39.458679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1222/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:39 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:40.481438 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:40.482086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:40.488553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:40.489039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:40.489482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:40.490169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:40.490627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:40.491054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:40.551794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:40.560663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0839e4fa-28a8-4085-a3f6-7e8ebc8a5fee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082497 Nov 02 04:01:40.561223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1218/2440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:41.583238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:41.583850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:41.590310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:41.590790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:41.591222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:41.591904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:41.592379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:41.592848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:41.657123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:41.665300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-17009ae2-1472-43db-b533-b7f5c9951b80 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085913 Nov 02 04:01:41.665856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1223/2441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:42.689079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:42.689685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:42.696005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:42.696482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:42.696909 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:42.697585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:42.698029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:42.698446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:42.757964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:42.766615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d08f991f-bd95-4788-91e6-4ab43f9f0c99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081881 Nov 02 04:01:42.767170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1219/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:43.789310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:43.789869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:43.796232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:43.796707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:43.797139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:43.797822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:43.798274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:43.798696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:43.859102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:43.867309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7fa037a9-24c3-4405-b49d-7829f96a4054 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082009 Nov 02 04:01:43.867864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1224/2443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:44.890680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:44.891321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:44.897678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:44.898157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:44.898598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:44.899287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:44.899737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:44.900193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:44.959778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:44.968359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5623df23-03b8-40cb-a9e6-f8b8aff1c560 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081523 Nov 02 04:01:44.968915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1220/2444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:45.990540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:45.991185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:45.997487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:45.997960 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:45.998933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:45.999873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:46.000346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:46.000769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:46.062831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:46.070950 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e882778d-35e0-4bb2-a0e3-a48ba11f55ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084295 Nov 02 04:01:46.071506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1225/2445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:47.094522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:47.095143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:47.101472 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:47.101968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:47.102413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:47.103136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:47.103571 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:47.104083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:47.164736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:47.172688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-84de2b80-a164-494a-9ce4-0834959fa0ee tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082651 Nov 02 04:01:47.173244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1221/2446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:48.194680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:48.195231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:48.202227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:48.202708 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:48.203145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:48.203831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:48.204333 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:48.204761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:48.271744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:48.280058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4546a2cb-8e0b-4f95-a430-fb4d4beabbd8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.089303 Nov 02 04:01:48.280622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1226/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:49.302501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:49.303164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:49.309453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:49.309930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:49.310362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:49.311065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:49.311519 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:49.311940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:49.373904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:49.382339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-97a86d6e-bd0e-415a-86c3-aab22e999388 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083663 Nov 02 04:01:49.382895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1222/2448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:49 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:50.405728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:50.406317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:50.412694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:50.413168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:50.413597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:50.414274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:50.414721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:50.415140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:50.478873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:50.487060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a6d3ebd4-39f3-470c-9d43-a42c54764403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085232 Nov 02 04:01:50.487613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1227/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:51.510221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:51.510828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:51.517756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:51.518228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:51.518661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:51.519337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:51.519782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:51.520226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:51.579883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:51.587918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c48ef7a6-bdea-4ea0-b03e-190e298ccc6f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081614 Nov 02 04:01:51.588499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1223/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:52.611086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:52.611702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:52.618235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:52.618718 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:52.619156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:52.619846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:52.620330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:52.620756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:52.680292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:52.688932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d83c88f8-8fb5-4c92-aaf6-5069a03a6d04 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081680 Nov 02 04:01:52.689487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1228/2451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:53.712558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:53.713165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:53.719441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:53.719912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:53.720398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:53.721070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:53.721521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:53.721938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:53.782794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:53.791129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-53882b32-8795-4442-aa63-de16cae8233f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082441 Nov 02 04:01:53.791684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1224/2452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:54.814823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:54.815369 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:54.821836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:54.822312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:54.822744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:54.823424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:54.823892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:54.824323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:54.887472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:54.896239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7721f5a3-89ba-454b-9ea1-6287301404f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085821 Nov 02 04:01:54.896797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1229/2453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:55.919110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:55.919672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:55.926175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:55.926648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:55.927082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:55.927758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:55.928231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:55.928668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:55.987903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:55.995991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0e3e0ec8-711c-4753-b421-77b361a7b082 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080790 Nov 02 04:01:55.996543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1225/2454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:57.018639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:57.019260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:57.025687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:57.026173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:57.026613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:57.027311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:57.027798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:57.028247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:57.089046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:57.097723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4b83de89-18b2-4713-ad64-f8df1e2b8057 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082946 Nov 02 04:01:57.098296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1230/2455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:01:58.120935 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:58.121570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:58.128240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:58.128717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:58.129151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:58.129832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:58.130285 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:58.130710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:58.190014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:58.198037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5158b77d-e7d1-4248-a55b-9f501f8b95b6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080960 Nov 02 04:01:58.198601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1226/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:58 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:01:59.221604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:01:59.222219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:01:59.228282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:59.228757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:59.229191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:59.229865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:01:59.230315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:01:59.230735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:01:59.292693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:01:59.301463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f1eef84-3286-4e7c-af5c-a4beb32bb73b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083752 Nov 02 04:01:59.302022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1231/2457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:01:59 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:00.324366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:00.324977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:00.331911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:00.332417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:00.332849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:00.333523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:00.334581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:00.335009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:00.395062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:00.403053 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-723f554f-60d1-41ef-8d41-a5d38decd896 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082511 Nov 02 04:02:00.403607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1227/2458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:00 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:01.426602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:01.427216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:01.433547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:01.434022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:01.434451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:01.435128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:01.436186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:01.436616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:01.496868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:01.505236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3f09073d-6098-44f6-ae5f-4373e577bacc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082540 Nov 02 04:02:01.505791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1232/2459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:02:02.526924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:02.527547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:02.534166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:02.534649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:02.535087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:02.535775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:02.536256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:02.536681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:02.597431 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:02.605559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-934eb4ea-9259-4b4d-92d5-9d229cb368d9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082557 Nov 02 04:02:02.606130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1228/2460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:02 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:03.628713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:03.629331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:03.635901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:03.636410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:03.636849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:03.637539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:03.637994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:03.638934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:03.704329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:03.712963 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fda64dcd-59da-4644-b24e-9157b7d3c0f9 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.088126 Nov 02 04:02:03.713525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1233/2461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:03 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:04.736569 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:04.737253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:04.743422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:04.743893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:04.744363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:04.745044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:04.745490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:04.745908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:04.808186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:04.816300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-220852f0-009a-4e9e-8604-61a724fd5ec2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084258 Nov 02 04:02:04.816846 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1229/2462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:04 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:05.839325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:05.839934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:05.842265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:05.847651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:05.848161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:05.848596 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:05.849278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:05.849728 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:05.850148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:05.852811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:05.911926 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:05.920615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-89c9267c-0382-42d6-aa48-4b33c4737d5c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085150 Nov 02 04:02:05.921175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1234/2463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:05 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:06.943287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:06.943906 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:06.946219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:06.952004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:06.952491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:06.952929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:06.953612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:06.954065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:06.954490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:06.957196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:07.017293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:07.025425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0f8a6e5c-91ed-4665-92e0-b36fd8e7fa47 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085986 Nov 02 04:02:07.025995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1230/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:06 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:08.048488 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:08.049110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:08.055536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:08.056049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:08.056492 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:08.057178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:08.057637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:08.058069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:08.119699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:08.128710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-33c7b90b-e654-4a59-bbec-a2268c2e2271 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084602 Nov 02 04:02:08.129262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1235/2465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:08 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:09.150595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:09.151131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:09.153104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:02:09.153274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 04:02:09.159475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:09.159974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:09.160413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:09.161132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:09.161585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:09.162008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:09.222977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:09.231060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0ebec57c-c843-483e-a36c-6f539129ef44 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084324 Nov 02 04:02:09.231618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1231/2466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:09 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:10.253778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:10.254401 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:10.260829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:10.261316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:10.261760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:10.262455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:10.262916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:10.263849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:10.323276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:10.331899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-39779de8-4a86-4d37-ac7e-2fb6515a6e45 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082006 Nov 02 04:02:10.332557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1236/2467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:10 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:11.355411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:11.356086 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:11.363026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:11.363502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:11.363971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:11.364655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:11.365102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:11.365520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:11.426730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:11.434871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58b65fdd-d815-4385-ba92-8cc222720e1e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083319 Nov 02 04:02:11.435929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1232/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:11 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:12.457739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:12.458298 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:12.464702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:12.465177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:12.465607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:12.466879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:12.467332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:12.467762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:12.530993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:12.539222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6174eef2-341f-4710-a02f-f79031d31729 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085405 Nov 02 04:02:12.539780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1237/2469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:12 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:13.561521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:13.562152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:13.568734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:13.569206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:13.569636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:13.570313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:13.570758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:13.571175 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:13.631027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:13.639248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9108c414-44b3-471b-8025-76f9f1303840 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081590 Nov 02 04:02:13.639805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1233/2470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:13 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:14.662230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:14.662852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:14.664861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:02:14.665007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 04:02:14.672123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:14.672604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:14.673048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:14.673736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:14.674192 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:14.674615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:14.735086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:14.743136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9f19701b-d4c7-4a67-8f00-b19883fae273 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084749 Nov 02 04:02:14.743694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1238/2471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:14 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:15.767347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:15.768336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:15.770321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:02:15.770470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 04:02:15.777902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:15.778384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:15.778821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:15.779514 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:15.780036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:15.780426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:15.840653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:15.848753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2f6ca62c-848a-4166-8204-b8ab09438902 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085912 Nov 02 04:02:15.849321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1234/2472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:15 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:16.870831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:16.871393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:16.878044 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:16.878533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:16.878975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:16.879666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:16.880152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:16.880580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:16.946434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:16.955102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f119b4e8-4491-49f8-af8b-9f8b894888cf tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.088310 Nov 02 04:02:16.955666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1239/2473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:16 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:17.978344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:17.979020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:17.986022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:17.986502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:17.986936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:17.987620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:17.988103 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:17.988529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:18.048373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:18.056401 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0da83ce2-d1ff-42c3-ba93-2abdd0df1ce6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081934 Nov 02 04:02:18.056959 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1235/2474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:17 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:19.079591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:19.080231 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:19.086681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:19.087145 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:19.087583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:19.088306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:19.088761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:19.089185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:19.150383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:19.159656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-eebddf30-9775-41dc-975e-8b2911a4851c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084573 Nov 02 04:02:19.160195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1240/2475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:19 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:20.183158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:20.183773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:20.190786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:20.191282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:20.191715 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:20.192419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:20.192912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:20.193332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:20.254530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:20.262526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3db3c98a-5209-42b2-9d66-a245955f1ea7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.083260 Nov 02 04:02:20.263108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1236/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:20 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:21.285219 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:21.285828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:21.292240 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:21.292717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:21.293146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:21.293823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:21.294272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:21.294694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:21.358512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:21.366639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6271a052-17be-4a51-a9b4-3a17ea3e20ea tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085332 Nov 02 04:02:21.367200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1241/2477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:21 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:22.390181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:22.390795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:22.397192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:22.397668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:22.398101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:22.398775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:22.399225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:22.399646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:22.459493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:22.467963 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2e12831d-ace9-4773-af50-bf73219e0ead tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081573 Nov 02 04:02:22.468521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1237/2478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:22 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:23.490665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:23.491262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:23.493238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:02:23.493391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 (ip 10.222.0.26) !!! Nov 02 04:02:23.500043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:23.500532 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:23.500973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:23.501666 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:23.502125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:23.502553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:23.563929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:23.572055 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-90961e13-6ca9-492f-ae50-31726d42fd20 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085299 Nov 02 04:02:23.572607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1242/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:23 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:24.595066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:24.595677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:24.601777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:24.602266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:24.602686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:24.603367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:24.603816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:24.604267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:24.664224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:24.673117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dbd040df-a3c2-4856-a19c-34947778d089 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081906 Nov 02 04:02:24.673671 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1238/2480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:24 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:25.696308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:25.696922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:25.704008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:25.704517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:25.704947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:25.705656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:25.706105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:25.706528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:25.770768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:25.778943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-850a2bc8-1722-418c-9b69-ac979da38618 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086489 Nov 02 04:02:25.779573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1243/2481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:25 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:26.801460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:26.801996 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:26.808344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:26.808820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:26.809251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:26.810532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:26.810979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:26.811403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:26.873534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:26.882134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77b85a03-b160-49f0-911e-5c920c808464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084520 Nov 02 04:02:26.882724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1239/2482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:26 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:27.904047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:27.904591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:27.910676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:27.911152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:27.911585 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:27.912300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:27.912751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:27.913171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:27.972366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:27.980415 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cf6cda83-a999-46b5-b210-99bc7e990e99 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080258 Nov 02 04:02:27.980972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1244/2483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:27 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:29.003237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:29.003849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:29.010266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:29.010760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:29.011188 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:29.011861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:29.012342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:29.013249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:29.072301 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:29.080755 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-895a03a7-938b-47e4-bc6e-027c9ef12f27 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081676 Nov 02 04:02:29.081306 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1240/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:28 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:30.104174 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:30.104794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:30.111924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:30.112432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:30.112869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:30.113561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:30.114018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:30.114447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:30.177540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:30.185769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0cab3485-cccb-4c6a-b2a4-9f97c7f01519 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085531 Nov 02 04:02:30.186325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1245/2485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:30 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:31.207991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:31.208575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:31.214862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:31.215338 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:31.216337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:31.217015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:31.217463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:31.217883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:31.276945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:31.285593 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-38fa066e-cc7f-4fcd-8a2c-638370706ce8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081614 Nov 02 04:02:31.286143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1241/2486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:31 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:32.308072 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:32.308711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:32.315073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:32.315552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:32.316018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:32.316707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:32.317171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:32.317597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:32.379796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:32.388166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da27669e-9b3a-4e97-b2d6-7c551e6b4220 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084024 Nov 02 04:02:32.388733 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1246/2487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:32 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:33.411154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:33.411766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:33.418398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:33.419375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:33.419802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:33.420501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:33.420950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:33.421368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:33.480441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:33.489037 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d444592f-be2c-4dcd-80de-92b3e5dc118a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081752 Nov 02 04:02:33.489592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1242/2488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:33 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:34.512441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:34.513036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:34.519716 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:34.520223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:34.520662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:34.521342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:34.521794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:34.522216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:34.584753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:34.593301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-20891a75-f795-4d20-8a94-e8a121be0277 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084874 Nov 02 04:02:34.593860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1247/2489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:34 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:35.616312 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:35.616859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:35.624332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:35.624809 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:35.625238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:35.625913 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:35.626358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:35.626774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:35.688615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:35.696601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9b426149-4a67-4c14-b68c-f77aa2dc5b85 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084242 Nov 02 04:02:35.697157 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1243/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:35 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:02:36.719384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:36.720031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:36.722421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=28 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:36.727727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:36.728230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:36.728672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:36.729364 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:36.729836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:36.730245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:36.733618 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=84 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:36.791456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:36.800248 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ca8789e3-432c-4091-b645-4a7d15473b8b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085227 Nov 02 04:02:36.800827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1248/2491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:36 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:37.824132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:37.825165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:37.827480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=28 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:37.832655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:37.833141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:37.833581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:37.834276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:37.834730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:37.835159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:37.837867 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=84 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:02:37.896154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:37.904871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-41f0a2ae-ef34-4e26-8d6d-f169ed81386c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084752 Nov 02 04:02:37.905432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1244/2492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:37 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:38.926407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:38.927020 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:38.933391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:38.933865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:38.934913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:38.935589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:38.936064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:38.936485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:38.998610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:39.007027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c6b54b59-3d78-4a23-a863-4f7f14850740 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084441 Nov 02 04:02:39.007578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1249/2493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:38 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:40.029504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:40.030123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:40.036480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:40.036962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:40.037405 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:40.038097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:40.038546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:40.038970 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:40.249927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:40.258077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8e3ea01a-b044-4c38-ba8d-0874bdbb0b02 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.232407 Nov 02 04:02:40.258629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1245/2494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:40 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:41.280105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:41.280719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:41.287034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:41.287512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:41.287975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:41.288652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:41.289103 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:41.289525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:41.348965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:41.357014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9149ce04-4bff-4297-adee-3f227c766204 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080821 Nov 02 04:02:41.357573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1250/2495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:41 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:42.380363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:42.380978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:42.387988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:42.388469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:42.388899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:42.389580 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:42.390026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:42.390445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:42.449393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:42.457989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a7ff12d5-0822-4a12-a90e-5056ba0c52f2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081461 Nov 02 04:02:42.458531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1246/2496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:42 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:43.481755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:43.482371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:43.488767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:43.489250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:43.489690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:43.490381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:43.490839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:43.491265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:43.554356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:43.562529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3eb7cfa0-6fdb-48a3-9201-24c2be8d9ebc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085243 Nov 02 04:02:43.563093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1251/2497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:43 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:44.585162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:44.585771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:44.592721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:44.593198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:44.593627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:44.594298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:44.594742 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:44.595153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:44.655682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:44.663666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de2f67cd-e8ce-48e3-8884-a07ee6631c3b tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082372 Nov 02 04:02:44.664247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1247/2498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:44 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:45.686707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:45.687247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:45.693721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:45.694194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:45.694624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:45.695330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:45.695775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:45.696223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:45.758455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:45.767279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-25535ecd-e8bc-4179-a04c-abf469e1e07c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085052 Nov 02 04:02:45.767830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1252/2499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:45 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:46.789943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:46.790484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:46.797527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:46.798011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:46.798451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:46.799133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:46.799585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:46.800036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:46.862918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:46.871131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eeff4be7-0925-47ea-970e-e9787429edca tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.085106 Nov 02 04:02:46.871690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1248/2500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:46 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:47.893944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:47.894505 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:47.901042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:47.901525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:47.901965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:47.902659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:47.903116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:47.903547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:47.965928 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:47.973980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-42115657-30aa-4472-a769-34fea9895a36 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084083 Nov 02 04:02:47.974542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1253/2501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:47 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:48.998143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:48.998751 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:49.006129 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:49.006615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:49.007050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:49.007780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:49.008256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:49.008712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:49.072614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:49.081409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ce95e951-b047-4f3f-bdb3-1edce327b5a4 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.087662 Nov 02 04:02:49.081971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1249/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:48 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:50.103881 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:50.104506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:50.111427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:50.111906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:50.112371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:50.113053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:50.113506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:50.113929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:50.173734 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:50.181729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ef67d9f4-2742-46a1-821b-168eb4a3ad15 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081731 Nov 02 04:02:50.182285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1254/2503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:50 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:51.205217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:51.205823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:51.212085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:51.212610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:51.212975 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:51.213686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:51.214138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:51.214563 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:51.274018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:51.282206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2a413959-6b90-4eae-bcc3-e6039383a53d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.080908 Nov 02 04:02:51.282759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1250/2504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:51 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:52.304980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:52.305594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:52.312066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:52.312551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:52.312991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:52.313685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:52.314142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:52.314604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:52.377085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:52.385245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edbbc167-261b-480e-a40a-6a28d2ef8a23 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.084220 Nov 02 04:02:52.386007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1255/2505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:52 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:53.408576 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:53.409184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:53.415488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:53.415974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:53.416418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:53.417094 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:53.417544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:53.417964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:53.477833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:53.485851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a2ff9522-0b56-47e3-90d6-b08484b6f4ac tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.081194 Nov 02 04:02:53.486415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1251/2506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:53 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:54.509224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:54.509754 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:54.516597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:54.517080 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:54.517512 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:54.518227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:54.518681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:54.519104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:54.579722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:54.587827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1024f2c9-c421-4009-a9a3-ef3d497da323 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082572 Nov 02 04:02:54.588418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1256/2507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:54 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:55.611829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:55.612663 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:55.619415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:55.619892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:55.620395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:55.622070 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:55.622513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:55.622933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:55.682105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:55.690495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-33ea28cd-d67e-40d8-8e49-a5cb46fa22c7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.082570 Nov 02 04:02:55.691042 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1252/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:55 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:56.713652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:56.714271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:56.720732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:56.721215 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:56.721654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:56.722341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:56.722796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:56.723225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:56.787559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:56.796336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ace49883-569e-42dd-97df-a0ef9e94624e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086509 Nov 02 04:02:56.796898 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1257/2509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:56 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:57.819482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:57.820143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:02:57.827193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:57.827668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:57.828134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:57.828817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:02:57.829287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:02:57.829707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:02:57.893422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:02:57.901561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2fea3e6e-d228-43d9-af9b-d2708c6e3403 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 200 len: 1368 microversion: 2.1 time: 0.086060 Nov 02 04:02:57.902127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1253/2510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:02:57 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:02:57.924340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a0199c98-6a76-4ce2-a448-473c483b220a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '.version_select at 0x7f5c923b20d0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:02:57.945988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a0199c98-6a76-4ce2-a448-473c483b220a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101323682" status: 202 len: 0 microversion: 2.1 time: 0.025664 Nov 02 04:02:57.946609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1258/2511] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 04:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101323682 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:02:58.833217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1dde9fe1-5499-4d5d-865a-c53ccc513ee7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'create', calling method: .version_select at 0x7f5c95c79160>, body: {"keypair": {"name": "tempest-keypair-1100566375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItUoJRMuqPQbr4r5JHVDJXwYJyld/VZr/CcXU071o+W2QCs0i92Sx6JkOtOzJaJ38S1GyOF60IAksZ+9SVCZacaXN2skU/KUitetDKLDI7xpKCmOr+ZUu1VUI7hZqyJEQ=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:02:58.849598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-1dde9fe1-5499-4d5d-865a-c53ccc513ee7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:02:58.853771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-1dde9fe1-5499-4d5d-865a-c53ccc513ee7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for user 18355f4225c9427dbb38fde84115d7b2 and project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:02:58.878859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1dde9fe1-5499-4d5d-865a-c53ccc513ee7 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049479 Nov 02 04:02:58.879449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1254/2512] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 04:02:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:00.149130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-389773088", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0f55973-8bdc-47ed-9a04-fee096583b88"}], "security_groups": [{"name": "tempest-securitygroup--199173085"}], "key_name": "tempest-keypair-1100566375", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:00.252891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] validate_networks() for [('d0f55973-8bdc-47ed-9a04-fee096583b88', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:03:00.697296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:03:00.697780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:03:00.698261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:03:00.698678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:03:00.699703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:03:00.708517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:00.708997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:00.709462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:00.710184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:00.710642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:00.711068 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:00.730904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:03:00.734822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Getting quotas for user 18355f4225c9427dbb38fde84115d7b2 and project 85403204e27c40ffb0155dd8aba3d77b. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:03:00.745697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:03:00.748472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:03:00.798091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-035850f2-8ad6-4fc3-9053-d27c2eb3126d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653774 Nov 02 04:03:00.798724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1259/2513] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:03:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:03:00.810802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-70f71f8a-b97a-4049-924f-44871db4bd89 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:00.811468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-70f71f8a-b97a-4049-924f-44871db4bd89 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:00.864894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-70f71f8a-b97a-4049-924f-44871db4bd89 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:00.872283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-70f71f8a-b97a-4049-924f-44871db4bd89 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1237 microversion: 2.1 time: 0.066388 Nov 02 04:03:00.873033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1255/2514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:00 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:01.897675 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:01.898233 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:01.904882 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:01.905370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:01.905815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:01.906498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:01.906947 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:01.907370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:01.971836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:01.979515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-781d0e75-70bd-4ee7-9899-bfa17c18fee6 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1289 microversion: 2.1 time: 0.086326 Nov 02 04:03:01.980106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1260/2515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:01 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:03.002309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:03.002925 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:03.009582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:03.010186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:03.010631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:03.011331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:03.011841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:03.012432 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:03.153079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:03.161238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-61799c00-3d16-4353-a4d5-c8bf44dc2ab2 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.162703 Nov 02 04:03:03.165248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1256/2516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:02 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:03:03.695537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f6efd2-fc78-4320-a7d7-a9458c83ff0a", "tag": "a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:03.706677 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:03.707162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:03.707601 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:03.718622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] Creating event network-changed:a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee for instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a on hv-cinder-86020 Nov 02 04:03:03.724798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-9b09a8d3-1c1a-44a5-97ad-3e8ecb4df21a req-020a6863-ca0a-46af-9205-ce45bafc97f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103044 Nov 02 04:03:03.725423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1261/2517] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:04.185013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:04.185543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:04.191862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:04.192370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:04.192805 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:04.193521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:04.193971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:04.194397 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:04.320516 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:04.328059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6513ccfe-1307-42d2-9025-cc03bd733029 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.147677 Nov 02 04:03:04.328618 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1257/2518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:04 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:05.351563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:05.352301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:05.358440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:05.358931 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:05.359379 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:05.360111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:05.360578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:05.361014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:05.490828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:05.499234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a00c267f-7768-4a4f-8db4-ee0fbf194300 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.152056 Nov 02 04:03:05.499803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1262/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:05 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:06.522343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:06.523019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:06.529391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:06.530128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:06.530286 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:06.530961 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:06.531408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:06.531824 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:06.656989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:06.664545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-049f9d5e-210b-4d79-80fe-d122cecdb29a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.146068 Nov 02 04:03:06.665110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1258/2520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:06 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:07.688007 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:07.688568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:07.690983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:07.697094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:07.697580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:07.698021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:07.698766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:07.699762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:07.700211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:07.703244 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=76 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:07.829997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:07.837911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4f66024c-f10a-4bb0-a6c8-ae1563460a2d tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.153889 Nov 02 04:03:07.838508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1263/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:07 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:08.860891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:08.861503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:08.863972 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:08.869055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:08.869532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:08.869967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:08.871276 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:08.871730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:08.872182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:08.875814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=78 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:09.001907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:09.015258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-da9674cc-7bf4-4f65-b0f4-705ecaf21835 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.152475 Nov 02 04:03:09.016238 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1259/2522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:08 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:09.085196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f6efd2-fc78-4320-a7d7-a9458c83ff0a", "name": "network-vif-plugged", "status": "completed", "tag": "a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:09.095864 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:09.096371 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:09.096799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:09.107971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] Creating event network-vif-plugged:a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee for instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a on hv-cinder-86020 Nov 02 04:03:09.112919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-f8acf3ff-6662-4fcc-b717-ae0dbb38a537 req-344e3448-0e0f-4b67-a0fd-8199d93d305a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102174 Nov 02 04:03:09.113481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1264/2523] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:10.039052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:10.039660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:10.045945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:10.046419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:10.046851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:10.047527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:10.048019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:10.048444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:10.175834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:10.184052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9cfc2ee0-80a8-4c0c-a77a-0981c9c8e594 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1362 microversion: 2.1 time: 0.148192 Nov 02 04:03:10.184619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1260/2524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:10 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:11.204707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:11.205458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:11.209633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:11.210331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:11.217267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:11.217746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:11.218182 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:11.218868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:11.219328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:11.219751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:11.345768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:11.353349 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ae2b1b96-cf3c-4015-9d55-66d11067658e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1548 microversion: 2.1 time: 0.150192 Nov 02 04:03:11.353908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1265/2525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:11 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:11.376266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:11.376794 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:11.378606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:11.384475 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:11.384953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:11.385392 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:11.386084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:11.387135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:11.387602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:11.462482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-02583525-48cd-4714-adf2-621557cf1464 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090294 Nov 02 04:03:11.463079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1261/2526] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 04:03:11 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:12.622051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f6efd2-fc78-4320-a7d7-a9458c83ff0a", "tag": "a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:12.631760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:12.638045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:12.638770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:12.650130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] Creating event network-changed:a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee for instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a on hv-cinder-86020 Nov 02 04:03:12.655846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-28cbaf83-e38b-41bf-aa43-a2c12aed3828 req-a627286a-077c-4b93-890c-b5a939aeeaa5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089895 Nov 02 04:03:12.656484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1266/2527] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:37.944741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=5 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:37.945763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=15 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:37.949589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:37.950120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:37.957206 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:37.957696 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:37.958141 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:37.958832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:37.959291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:37.959721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:37.984880 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:03:38.049647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [c193871e-78f7-4eb1-aaa6-b21751b463e7] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 04:03:39.056459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [c193871e-78f7-4eb1-aaa6-b21751b463e7] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41474. Nov 02 04:03:39.076903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ea9949c8-89fe-424c-b8a3-3c8ae0ec18be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 204 len: 0 microversion: 2.1 time: 1.133613 Nov 02 04:03:39.077484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1262/2528] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:03:37 2022] DELETE /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:03:39.083556 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=7 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:39.084323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=15 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:39.088279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:39.088981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:39.095803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:39.096309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:39.096746 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:39.097439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:39.097892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:39.098319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:39.232461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:39.240059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3da71479-bbaf-47b7-80cb-78d5a8e2f7eb tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1683 microversion: 2.1 time: 0.158164 Nov 02 04:03:39.240615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1267/2529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:39 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:40.264622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:40.265317 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:40.272324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:40.272806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:40.273565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:40.273932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:40.274383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:40.274812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:40.337228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:40.345610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2d7be33b-8942-463d-819c-2573ac02d08a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 200 len: 1615 microversion: 2.1 time: 0.085912 Nov 02 04:03:40.346173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1263/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:40 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:40.494418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9474bf60-b056-4517-8d79-aee88adc9b4d", "name": "network-vif-deleted", "tag": "4a21016c-1ed6-402f-adef-37dd2c2f184a"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:40.505131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:40.505612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:40.506052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:40.524015 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] Creating event network-vif-deleted:4a21016c-1ed6-402f-adef-37dd2c2f184a for instance 9474bf60-b056-4517-8d79-aee88adc9b4d on hv-cinder-86020 Nov 02 04:03:40.529411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-4ea5e204-1699-43f3-95be-e4f228d1831f req-6dfd8c37-0cb5-4292-a217-a4c4f8dfb076 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038560 Nov 02 04:03:40.530535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1268/2531] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:41.368912 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:41.369590 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:41.376469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:41.376954 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:41.377390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:41.378089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:41.378883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:41.379557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:41.393434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d HTTP/1.1 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:03:41.396024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:03:41.397950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '9474bf60-b056-4517-8d79-aee88adc9b4d'} Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:03:41.399402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:03:41.401453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:03:41.403135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:03:41.403135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ccd2c6c6-dbf3-42b7-a2d0-bfeda40e637c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 404 len: 111 microversion: 2.1 time: 0.032827 Nov 02 04:03:41.403135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1264/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:41 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:03:41.409498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-25926096-ea2f-4039-b463-9ba5f90bc48a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '.version_select at 0x7f5c92457790>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:41.430730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-25926096-ea2f-4039-b463-9ba5f90bc48a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136729239" status: 202 len: 0 microversion: 2.1 time: 0.025440 Nov 02 04:03:41.431308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1269/2533] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 04:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136729239 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:03:42.034987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d4c3f547-2568-41a0-ab64-d7945d264504 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: .version_select at 0x7f5c95c79d30>, body: {"keypair": {"name": "tempest-keypair-139532163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt0qJdC/Lgo9aHDQaFSz8a2ausVRjXCIjWXKoxLoAs3d8vGqMDK1JNj3JekUgLV0XlQuYh7eW7bxEdLuh/blckYS8CPnbfkg1sv3vsIaZc/duCaa/DEKTmtduGzoFg4sg=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:42.052788 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-d4c3f547-2568-41a0-ab64-d7945d264504 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:03:42.056600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-d4c3f547-2568-41a0-ab64-d7945d264504 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:03:42.078719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d4c3f547-2568-41a0-ab64-d7945d264504 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047688 Nov 02 04:03:42.079292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1265/2534] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 04:03:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:43.389422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1768693640", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e09a0e-4e79-4d08-a329-49c34bfe3e5f"}], "security_groups": [{"name": "tempest-securitygroup--346466363"}], "key_name": "tempest-keypair-139532163", "user_data": "}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:43.492693 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] validate_networks() for [('d4e09a0e-4e79-4d08-a329-49c34bfe3e5f', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:03:43.852256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:03:43.852703 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:03:43.853179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:03:43.853586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:03:43.854506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:03:43.863112 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:43.863582 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:43.864047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:43.864762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:43.865209 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:43.865630 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:43.882443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:03:43.886262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Getting quotas for user 7984dc1d452a4c998b44e6d26a299df8 and project 10a674b48d484716a8a79d518ea0d579. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:03:43.896824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:03:43.899123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:03:43.945608 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d0158dfd-6c92-45b9-9009-224c8df690d7 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561462 Nov 02 04:03:43.946170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1270/2535] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:03:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:03:43.957693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5c746df6-f20a-4f4c-9e42-67151439f680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:43.958374 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5c746df6-f20a-4f4c-9e42-67151439f680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:44.014084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-5c746df6-f20a-4f4c-9e42-67151439f680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:44.021056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5c746df6-f20a-4f4c-9e42-67151439f680 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1241 microversion: 2.1 time: 0.067740 Nov 02 04:03:44.021616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1266/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:43 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:45.043642 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:45.044915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:45.051812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:45.052331 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:45.052772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:45.053462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:45.053918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:45.054348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:45.115788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:45.124668 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3c44de16-0d01-442f-a14d-5c2af8e9b9cc tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1293 microversion: 2.1 time: 0.085415 Nov 02 04:03:45.125239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1271/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:45 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:03:46.147505 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:46.148170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:46.155108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:46.155656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:46.156192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:46.156937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:46.157474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:46.157958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:46.288283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:46.296227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b4919400-355b-41f0-9322-fa56aa5aa9de tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.152810 Nov 02 04:03:46.296838 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1267/2538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:46 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:46.544598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d21cae-71f8-4bc3-af2d-c18aa90359ed", "tag": "be76cc1f-3483-49a0-8644-0fd0412620b7"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:46.555204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:46.555732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:46.556183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:46.570186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] Creating event network-changed:be76cc1f-3483-49a0-8644-0fd0412620b7 for instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed on hv-cinder-86020 Nov 02 04:03:46.575639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-aa758f4c-a098-456f-84e7-0c8ddf66a844 req-5a776259-2d3a-428a-ab6e-32bda4318ca6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034803 Nov 02 04:03:46.576424 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1272/2539] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:47.318896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:47.319512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:47.325890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:47.326365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:47.326800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:47.327478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:47.327928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:47.328373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:47.456050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:47.463535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-35d028c7-ef0a-401b-891f-88144fd034a8 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.148551 Nov 02 04:03:47.464606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1268/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:47 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:03:48.487838 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:48.488500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:48.494573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:48.495048 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:48.496146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:48.496833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:48.497278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:48.497700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:48.609903 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:48.610467 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:48.617102 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:48.617672 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:48.618207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:48.619008 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:48.619691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:48.620151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:48.626265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:48.633921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-29414c4b-2a59-4b32-8e64-5d7b7da39cf1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.150795 Nov 02 04:03:48.634695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1273/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:48 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:48.644257 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-15f5d3bf-94a4-4763-8d68-d61197a778db tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a/ips" status: 200 len: 145 microversion: 2.1 time: 0.038177 Nov 02 04:03:48.644818 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1269/2542] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 04:03:48 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:03:49.656161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:49.656776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:49.663218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:49.663696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:49.664163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:49.664854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:49.665306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:49.665726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:49.799245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:49.806938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c5c65c7c-15ae-4426-baac-0447e3c96538 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.154637 Nov 02 04:03:49.807499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1274/2543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:49 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:50.830348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:50.830929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:50.837515 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:50.837988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:50.838418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:50.839105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:50.839555 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:50.840001 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:50.974273 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:50.982530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6985ed33-c9cd-438f-a555-a3c45cebd61a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.156168 Nov 02 04:03:50.983089 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1270/2544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:50 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:51.191251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21cae-71f8-4bc3-af2d-c18aa90359ed", "name": "network-vif-plugged", "status": "completed", "tag": "be76cc1f-3483-49a0-8644-0fd0412620b7"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:51.201288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:51.201762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:51.202195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:51.213163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] Creating event network-vif-plugged:be76cc1f-3483-49a0-8644-0fd0412620b7 for instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed on hv-cinder-86020 Nov 02 04:03:51.218543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-46095bb0-91ea-48d0-b693-544112087096 req-f3928f22-e999-4806-80d6-77a0163216d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Nov 02 04:03:51.219129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1275/2545] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:03:52.005101 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:52.005723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:52.012839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:52.013324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:52.013764 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:52.014453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:52.014941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:52.015371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:52.147126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:52.154829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7fd40a4a-f78c-4936-a69d-136f62fb830c tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.153564 Nov 02 04:03:52.155328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1271/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:52 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:53.178481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:53.179090 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:53.185823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:53.186299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:53.186730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:53.187409 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:53.187858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:53.188312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:53.317291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:53.325527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b70c593-a917-4009-827f-fb11ef59a259 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1366 microversion: 2.1 time: 0.151761 Nov 02 04:03:53.326089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1276/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:53 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:54.347054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:54.347670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:54.349639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:54.355057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:54.355638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:54.356248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:54.356940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:54.357388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:54.357813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:54.485137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:03:54.492834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7d541d78-3973-45d4-94be-9bcff0222043 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1555 microversion: 2.1 time: 0.149726 Nov 02 04:03:54.493390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1272/2548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:03:54 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:03:54.515432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:03:54.515974 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:03:54.517910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:54.518564 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:03:54.524948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:54.525432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:54.525872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:54.526627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:54.527102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:54.527527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:54.606498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-75fa2df5-0432-4d78-9cd3-e03ef67722be tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094835 Nov 02 04:03:54.607095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1277/2549] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Nov 2 04:03:54 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:03:55.521105 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d21cae-71f8-4bc3-af2d-c18aa90359ed", "tag": "be76cc1f-3483-49a0-8644-0fd0412620b7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:03:55.532261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:03:55.532910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:03:55.533518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:03:55.545261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] Creating event network-changed:be76cc1f-3483-49a0-8644-0fd0412620b7 for instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed on hv-cinder-86020 Nov 02 04:03:55.550421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-e4808321-9a2d-4e5b-b16a-ab251567b8a1 req-b7cf4eb0-a2f9-4887-9729-94453d724d2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Nov 02 04:03:55.551010 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1273/2550] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:04:31.532520 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:31.533457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=42 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:31.604156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:31.604656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:31.610970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:31.611450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:31.611890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:31.612591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:31.613040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:31.613462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:31.637247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-55db6253-5aaf-4d6c-9d59-a157e72e7fa6 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/ips" status: 200 len: 149 microversion: 2.1 time: 0.106487 Nov 02 04:04:31.637791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1278/2551] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 04:04:31 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/ips => generated 149 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:04:48.721316 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:48.721895 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:48.724520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:48.725156 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:48.731434 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:48.731907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:48.732940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:48.733619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:48.734065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:48.734479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:48.761071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:04:48.832852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4beff8bb-9f33-4917-9ea8-6e63ee446888 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 204 len: 0 microversion: 2.1 time: 0.115345 Nov 02 04:04:48.833341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1274/2552] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:04:48 2022] DELETE /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:04:48.841568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:48.842165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:48.844671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:48.845354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=4 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:04:48.850936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:48.851419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:48.851860 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:48.852597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:48.853052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:48.853482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:49.054398 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:04:49.062031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9d31a8bb-803d-412e-ae09-2cfeccc5085c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1672 microversion: 2.1 time: 0.224366 Nov 02 04:04:49.062594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1279/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:04:48 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:04:50.086075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:50.086769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:50.094127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:50.094600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:50.095029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:50.095708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:50.096184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:50.096602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:50.224296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:04:50.231852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e93e2f4c-61a3-4f6b-a3ba-a2a40770060e tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1672 microversion: 2.1 time: 0.149966 Nov 02 04:04:50.232521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1275/2554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:04:50 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:04:51.255348 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:51.255986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:51.262767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:51.263327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:51.264644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:51.265610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:51.267269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:51.267269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:51.331263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18355f4225c9427dbb38fde84115d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85403204e27c40ffb0155dd8aba3d77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:04:51.338885 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f2165b46-afff-43f7-967b-1fdea215591c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 200 len: 1605 microversion: 2.1 time: 0.087492 Nov 02 04:04:51.339449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1280/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:04:51 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:04:51.423351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f6efd2-fc78-4320-a7d7-a9458c83ff0a", "name": "network-vif-deleted", "tag": "a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:04:51.438357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:51.438837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:51.439266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:51.453009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] Creating event network-vif-deleted:a1b0741b-bb37-45b2-81aa-f8e3d9aa37ee for instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a on hv-cinder-86020 Nov 02 04:04:51.459291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-91bd9a01-0aaf-4a8d-ae33-8bb2aa263ca0 req-6c1b4e41-2a24-42df-96ce-164b47fa2af3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040233 Nov 02 04:04:51.463007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1276/2556] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:04:52.361798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:52.362420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:52.368984 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:52.369724 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:52.370161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:52.370858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:52.371307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:52.371732 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:52.385650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] HTTP exception thrown: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Request method failure captured: Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a HTTP/1.1 Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUZ-fPFk7sc6-KadH5w-n2PGiuKQxVTTwke0NpgCpj-9hGMY94Xvaminm4-Rp6C-G7AAL8PVK4A0t7h-Gj2-5J0nzQQQ9_kMmnK0mT7hwIcJF9TuqMVgtEs0-F6uy_wO6IC9NDxP_d-TQgEWj6a3ULQTbHAMOWm4mfQOnRWOjnQZpY Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:04:52.387341 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}] Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 18355f4225c9427dbb38fde84115d7b2 Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:52.389654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'f3f6efd2-fc78-4320-a7d7-a9458c83ff0a'} Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:04:52.390607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:52.392805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:52.394390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Returning 404 to user: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:04:52.394390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6c047a2a-afa3-4ac6-b24a-c4ab791fd2dc tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 404 len: 111 microversion: 2.1 time: 0.031349 Nov 02 04:04:52.394390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1281/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:04:52 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:04:52.401160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-59074ef3-77a3-48bb-8b5b-0a137d76c893 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '.version_select at 0x7f5c9237d040>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:52.420549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-59074ef3-77a3-48bb-8b5b-0a137d76c893 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100566375" status: 202 len: 0 microversion: 2.1 time: 0.024215 Nov 02 04:04:52.421096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1277/2558] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Nov 2 04:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100566375 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 04:04:53.028110 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:53.028640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:53.035024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:53.035513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:53.035971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:53.036652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:53.037106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:53.037530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:53.051012 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] HTTP exception thrown: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Request method failure captured: Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a HTTP/1.1 Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUZ-fPFk7sc6-KadH5w-n2PGiuKQxVTTwke0NpgCpj-9hGMY94Xvaminm4-Rp6C-G7AAL8PVK4A0t7h-Gj2-5J0nzQQQ9_kMmnK0mT7hwIcJF9TuqMVgtEs0-F6uy_wO6IC9NDxP_d-TQgEWj6a3ULQTbHAMOWm4mfQOnRWOjnQZpY Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:04:53.052592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}] Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 18355f4225c9427dbb38fde84115d7b2 Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.054407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'f3f6efd2-fc78-4320-a7d7-a9458c83ff0a'} Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:04:53.055771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.057953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.060924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Returning 404 to user: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:04:53.060924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-349d7347-f176-484e-8c8b-4c59ea9d1a4a tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 404 len: 111 microversion: 2.1 time: 0.030269 Nov 02 04:04:53.060924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1282/2559] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:04:53 2022] DELETE /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:04:53.063221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:04:53.063977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: f3f6efd2-fc78-4320-a7d7-a9458c83ff0a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:04:53.071043 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:53.071523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:53.071977 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:53.072684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:04:53.073120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:04:53.073768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:04:53.087159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] HTTP exception thrown: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Request method failure captured: Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a HTTP/1.1 Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUZ-fPFk7sc6-KadH5w-n2PGiuKQxVTTwke0NpgCpj-9hGMY94Xvaminm4-Rp6C-G7AAL8PVK4A0t7h-Gj2-5J0nzQQQ9_kMmnK0mT7hwIcJF9TuqMVgtEs0-F6uy_wO6IC9NDxP_d-TQgEWj6a3ULQTbHAMOWm4mfQOnRWOjnQZpY Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:04:53.088849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}] Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 18355f4225c9427dbb38fde84115d7b2 Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.091218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'f3f6efd2-fc78-4320-a7d7-a9458c83ff0a'} Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:04:53.092588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. Nov 02 04:04:53.094331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:04:53.095816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Returning 404 to user: Instance f3f6efd2-fc78-4320-a7d7-a9458c83ff0a could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:04:53.095816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d217fb30-d38c-4695-8c90-7a8ae914596c tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a" status: 404 len: 111 microversion: 2.1 time: 0.031640 Nov 02 04:04:53.095816 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1278/2560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:04:53 2022] GET /compute/v2.1/servers/f3f6efd2-fc78-4320-a7d7-a9458c83ff0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:05:01.269749 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:05:01.270310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:05:01.276404 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:05:01.276887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:05:01.277329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:05:01.278022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:05:01.278481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:05:01.279491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:05:01.293365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea HTTP/1.1 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:05:01.295560 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.297251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'a5773140-5308-4eaf-8557-2d9739c592ea'} Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:05:01.298165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.299676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.301395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:05:01.301395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-757fa6ce-a35b-455f-91de-fac23c088266 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 404 len: 111 microversion: 2.20 time: 0.031074 Nov 02 04:05:01.301395 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1283/2561] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Nov 2 04:05:01 2022] DELETE /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 04:05:01.306623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:05:01.307220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] [instance: a5773140-5308-4eaf-8557-2d9739c592ea] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:05:01.313626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:05:01.314036 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:05:01.314659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:05:01.315348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:05:01.315798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:05:01.316255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:05:01.330076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] HTTP exception thrown: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Request method failure captured: Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea HTTP/1.1 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUN7o5d_Q0HdP-oBO0GBu7g2vPXg27Wv4PHAA9XBP6qHwwMPJKoHk-f_O87Tsw0WUT4fRMDZ7mN1FaKGj162F6odhIEN-ao_jYaIoUp7LBX7Nyf30yZBJNs9txXsX6RBRrSjHWD3_MJ3h8Ylycl9lwkKRbOGRdaiLrT1id_ip5jses Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:05:01.331606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d56f6d222a4d4411b8f4583c61f53129"}]}] Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: d56f6d222a4d4411b8f4583c61f53129 Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141778872 Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f16c6a2cd8594037ad47475ed1b3161c Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141778872-project Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.333522 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'a5773140-5308-4eaf-8557-2d9739c592ea'} Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:05:01.338052 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. Nov 02 04:05:01.339796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:05:01.344676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] Returning 404 to user: Instance a5773140-5308-4eaf-8557-2d9739c592ea could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:05:01.344676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-28ce93b3-f8e1-4be0-ba7a-d54db673a671 tempest-AttachVolumeShelveTestJSON-1141778872 tempest-AttachVolumeShelveTestJSON-1141778872-project] 10.222.0.26 "GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea" status: 404 len: 111 microversion: 2.20 time: 0.031303 Nov 02 04:05:01.344676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1279/2562] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Nov 2 04:05:01 2022] GET /compute/v2.1/servers/a5773140-5308-4eaf-8557-2d9739c592ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 04:06:47.488615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "223ca696-4563-46a6-82d6-af64da31d503"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:06:47.491526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:06:47.496938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=10 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:06:47.497841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=18 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:06:47.499102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:06:47.500300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 04:06:47.501790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:06:47.502009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 04:06:47.503259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:06:47.503394 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments (ip 10.222.0.26) !!! Nov 02 04:06:47.505163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:06:47.505720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:06:47.506430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:06:47.507692 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:06:47.508382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:06:47.521095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:06:51.073456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0acb7a00-ff67-4e9c-b621-78c380dee7f4 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "POST /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.593011 Nov 02 04:06:51.075997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1284/2563] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 04:06:47 2022] POST /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments => generated 194 bytes in 3596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:06:51.550588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:06:51.551408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:06:51.552833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:06:51.555228 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 04:06:51.560918 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb081e9-a274-4ed2-850c-750041b05e81", "name": "network-vif-deleted", "tag": "dc01b58c-e82f-4ea4-bb21-2631ca9a1a03"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:06:51.576146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:06:51.576623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:06:51.577056 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:06:51.589557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] Creating event network-vif-deleted:dc01b58c-e82f-4ea4-bb21-2631ca9a1a03 for instance 3cb081e9-a274-4ed2-850c-750041b05e81 on hv-cinder-86020 Nov 02 04:06:51.596040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-83a9d173-6f17-4569-bb8f-e39b15518ff3 req-cab966cd-9790-43a6-8bfd-17a3956c145b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047099 Nov 02 04:06:51.596924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1280/2564] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:06.430490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:06.431258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:06.435705 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:06.436365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:06.446656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:06.447120 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:06.447756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:06.457952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:06.458412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:06.459043 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:06.572681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lazy-loading 'services' on Instance uuid 96d21cae-71f8-4bc3-af2d-c18aa90359ed {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:07:06.651288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c0b8df61-2d7b-43f8-a740-627e47357b23 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments/223ca696-4563-46a6-82d6-af64da31d503" status: 202 len: 0 microversion: 2.1 time: 0.221620 Nov 02 04:07:06.652521 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1285/2565] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 04:07:06 2022] DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments/223ca696-4563-46a6-82d6-af64da31d503 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:07:06.664673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:06.669239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:06.678192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:06.678859 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:06.680887 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:06.682233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:06.682233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:06.682861 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:06.683639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:06.684097 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:06.745424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f1346f66-740a-4885-b297-4041c5917844 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087183 Nov 02 04:07:06.747393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1281/2566] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 04:07:06 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:07.762551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:07.767264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:07.778619 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:07.779481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:07.780332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:07.781822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:07.782792 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:07.783537 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:07.827050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-84edb6a6-a7e3-485e-b53e-394d22572d87 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069567 Nov 02 04:07:07.845768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1286/2567] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 04:07:07 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 04:07:07.934390 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:07.935981 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:07.944421 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:07.945126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:07.945813 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:07.946820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:07.947364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:07.948028 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:07.974952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:07:08.074678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc4e45af-f47a-4702-b16f-f28596c76731 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 204 len: 0 microversion: 2.1 time: 0.144662 Nov 02 04:07:08.075998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1282/2568] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:07:07 2022] DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:07:08.084186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:08.085050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:08.091301 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:08.091786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:08.092506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:08.093410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:08.093862 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:08.094458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:08.257993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:08.271628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-83766815-9cab-49e9-b1f4-3d2554f26aa0 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1680 microversion: 2.1 time: 0.191322 Nov 02 04:07:08.280042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1287/2569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:08 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:09.296110 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:09.296969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:09.303329 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:09.304125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:09.304570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:09.305537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:09.305988 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:09.306409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:09.473022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:09.482492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a9f3a12b-058a-44a9-8f92-f8d811b54e61 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1680 microversion: 2.1 time: 0.191571 Nov 02 04:07:09.483313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1283/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:09 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:10.508091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:10.509267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:10.524924 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:10.526462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:10.527481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:10.529159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:10.534130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:10.535557 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:10.924868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:10.943790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8dfbbb0d-eee6-4d80-8447-bce464241968 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1680 microversion: 2.1 time: 0.431696 Nov 02 04:07:10.962783 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1288/2571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:10 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1680 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:11.782630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21cae-71f8-4bc3-af2d-c18aa90359ed", "name": "network-vif-deleted", "tag": "be76cc1f-3483-49a0-8644-0fd0412620b7"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:11.814748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:11.815768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:11.816323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:11.830364 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] Creating event network-vif-deleted:be76cc1f-3483-49a0-8644-0fd0412620b7 for instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed on hv-cinder-86020 Nov 02 04:07:11.836647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-bcd54716-3ae0-42f0-b8cb-04ce3c22b3f6 req-1cd47d34-dddc-497b-a819-73f921264533 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059042 Nov 02 04:07:11.842832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1284/2572] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:11.977443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:11.978047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:11.992202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:11.992859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:11.993322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:11.994282 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:11.996126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:11.996606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:12.077151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:12.078496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:12.079740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:12.080432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lazy-loading 'fault' on Instance uuid 96d21cae-71f8-4bc3-af2d-c18aa90359ed {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:07:12.217139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7984dc1d452a4c998b44e6d26a299df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a674b48d484716a8a79d518ea0d579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:12.224959 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a2159006-10aa-48fe-9e8e-b94748537585 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 200 len: 1331 microversion: 2.1 time: 0.251802 Nov 02 04:07:12.235046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1289/2573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:11 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 1331 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:13.253499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:13.254197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:13.271229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:13.274280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:13.275904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:13.279277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:13.279760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:13.280227 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:13.315564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed HTTP/1.1 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:07:13.321973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:13.324328 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '96d21cae-71f8-4bc3-af2d-c18aa90359ed'} Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:13.325534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:13.327334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:13.335122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:13.337658 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d76da9e3-5c7c-4aad-9717-fbf77c0b885d tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 404 len: 111 microversion: 2.1 time: 0.088507 Nov 02 04:07:13.341667 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1285/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:13 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:07:13.351980 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8d4a34a6-5aea-42f2-b2ac-e8c6597aba63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '.version_select at 0x7f5c9248ab80>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:13.410964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8d4a34a6-5aea-42f2-b2ac-e8c6597aba63 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139532163" status: 202 len: 0 microversion: 2.1 time: 0.064912 Nov 02 04:07:13.412158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1290/2575] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 04:07:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139532163 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:07:16.050998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:16.052340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:16.064884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:16.066114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:16.067469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:16.068727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:16.069553 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:16.070022 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:16.086424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed HTTP/1.1 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:07:16.088016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.089642 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '96d21cae-71f8-4bc3-af2d-c18aa90359ed'} Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:16.090681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.092332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.094991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:16.094991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dee8f587-70a5-4383-9e8c-40274a948244 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 404 len: 111 microversion: 2.1 time: 0.044351 Nov 02 04:07:16.094991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1286/2576] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:07:16 2022] DELETE /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:07:16.100086 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:16.100806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 96d21cae-71f8-4bc3-af2d-c18aa90359ed] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:16.108036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:16.108538 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:16.109034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:16.109743 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:16.110207 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:16.110638 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:16.126570 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed HTTP/1.1 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:07:16.128559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.133737 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '96d21cae-71f8-4bc3-af2d-c18aa90359ed'} Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:16.135224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. Nov 02 04:07:16.136929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:16.139684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 96d21cae-71f8-4bc3-af2d-c18aa90359ed could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:16.141717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7c6911db-ffdb-4bb0-ae46-5638ec8bf5bd tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed" status: 404 len: 111 microversion: 2.1 time: 0.046526 Nov 02 04:07:16.142509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1291/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:16 2022] GET /compute/v2.1/servers/96d21cae-71f8-4bc3-af2d-c18aa90359ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 04:07:17.354299 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:17.354877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:17.367854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.369800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.370546 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.371549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.372290 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.373144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.395355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d HTTP/1.1 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:07:17.397907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.399904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '9474bf60-b056-4517-8d79-aee88adc9b4d'} Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:17.400924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.402572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.406719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:17.407991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3aa210d6-9331-4c5f-8f3b-874a4e61bae5 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 404 len: 111 microversion: 2.1 time: 0.058006 Nov 02 04:07:17.408834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1287/2578] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:07:17 2022] DELETE /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:07:17.418884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:17.420658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9474bf60-b056-4517-8d79-aee88adc9b4d] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:17.433609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.447498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.452672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.460742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.461903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.463460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.497667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d HTTP/1.1 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:07:17.506247 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.508440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '9474bf60-b056-4517-8d79-aee88adc9b4d'} Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:17.509484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. Nov 02 04:07:17.511284 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.515938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 9474bf60-b056-4517-8d79-aee88adc9b4d could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:17.521155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b916cf7c-b46d-4a9c-8d62-e705fc18011a tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d" status: 404 len: 111 microversion: 2.1 time: 0.105746 Nov 02 04:07:17.522942 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1292/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:17 2022] GET /compute/v2.1/servers/9474bf60-b056-4517-8d79-aee88adc9b4d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:07:17.543173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:17.544653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:17.561536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.562527 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.563139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.565139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.565957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.569937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.594544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 HTTP/1.1 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:07:17.599463 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.601345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '462d4a05-6687-47b8-b2c9-942b76d76274'} Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:17.602619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.604333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.607391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:17.608491 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c2b34f0-d901-4e33-8fc0-f367d82d9e33 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 404 len: 111 microversion: 2.1 time: 0.072366 Nov 02 04:07:17.614005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1288/2580] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:07:17 2022] DELETE /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:07:17.620722 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:17.621667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 462d4a05-6687-47b8-b2c9-942b76d76274] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:17.632853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.633672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.634387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.635748 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:17.636655 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:17.638017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:17.661268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 HTTP/1.1 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:07:17.663105 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.664961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '462d4a05-6687-47b8-b2c9-942b76d76274'} Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:17.665994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. Nov 02 04:07:17.667780 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:17.669727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 462d4a05-6687-47b8-b2c9-942b76d76274 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:17.669727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-9b371391-83b1-4cee-85fd-8c41dbe893e1 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274" status: 404 len: 111 microversion: 2.1 time: 0.049872 Nov 02 04:07:17.669727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1293/2581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:17 2022] GET /compute/v2.1/servers/462d4a05-6687-47b8-b2c9-942b76d76274 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 04:07:21.837872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Action: 'create', calling method: .version_select at 0x7f5c9242edc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-459270510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIncjD3HiiAQallF/w6h92Yx8qtIIisxdQ2Y5pH7BtUd4QL5VsdM0TfPmeWbPC4Ndb/UBDMOnEJNPni5w+CNHVfYjqtXJkK1wJWSh0BKKEztr0cQWyxSK/tl2I+krw4rZg=="}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:21.860284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Getting quotas for project 3e61d1b98c0b474a95a99962af8b20b5. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:07:21.865380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Getting quotas for user 7f89c4e2fa8c495fa8bc7f64a3635fe0 and project 3e61d1b98c0b474a95a99962af8b20b5. Resources: {'key_pairs'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:07:21.885487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [a5e34f3d-565e-4cde-a4c1-a6964172c54a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 04:07:22.903767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [a5e34f3d-565e-4cde-a4c1-a6964172c54a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42720. Nov 02 04:07:22.928262 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c7eb929e-6d1b-4a5c-9618-bf6e825dcf8f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.415170 Nov 02 04:07:22.929363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1289/2582] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 04:07:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:27.283440 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1050855645", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "networks": [{"uuid": "5a5d1039-6163-4e2d-99d5-7050ed2dc691"}]}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:27.351132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] validate_networks() for [('5a5d1039-6163-4e2d-99d5-7050ed2dc691', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:07:27.644139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:27.700190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:07:27.700622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:07:27.701161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:07:27.701576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:07:27.701991 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:07:27.711578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:27.712094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:27.712536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:27.713499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:27.713981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:27.714397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:27.734089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Getting quotas for project 7b9cca9a6f634ab4833986b65af4027f. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:07:27.738132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Getting quotas for user 7c13d0e399fb427284c900bf130f23a6 and project 7b9cca9a6f634ab4833986b65af4027f. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:07:27.749745 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:07:27.752076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:07:27.796975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a08fe78a-d951-4998-b0ab-57318b539712 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518694 Nov 02 04:07:27.797613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1294/2583] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:07:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:07:27.806345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:27.810461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9e8db188-383f-4d50-88c7-e2ae72f29cf2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:27.811150 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9e8db188-383f-4d50-88c7-e2ae72f29cf2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:27.873829 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9e8db188-383f-4d50-88c7-e2ae72f29cf2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:27.882863 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9e8db188-383f-4d50-88c7-e2ae72f29cf2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1214 microversion: 2.1 time: 0.077776 Nov 02 04:07:27.883574 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1290/2584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:27 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:28.907039 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:28.908759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:28.918178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:28.918739 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:28.919188 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:28.920017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:28.920491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:28.921616 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:28.986124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:28.995848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7a753337-4589-414d-9f40-9c7ba18287cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1274 microversion: 2.1 time: 0.093199 Nov 02 04:07:28.996837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1295/2585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:28 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:30.021059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:30.021797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:30.029408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:30.029951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:30.031076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:30.031800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:30.032441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:30.032783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:30.172032 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:30.180044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-387f3bce-efb0-40fb-a9c9-80d252c7cad5 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.164385 Nov 02 04:07:30.180958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1291/2586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:30 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:30.338281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394f567e-4b62-4783-98b7-87f3691816ee", "tag": "6af2705a-7a13-41df-94e5-f277a5742334"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:30.352246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:30.353181 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:30.353702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:30.366054 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] Creating event network-changed:6af2705a-7a13-41df-94e5-f277a5742334 for instance 394f567e-4b62-4783-98b7-87f3691816ee on hv-cinder-86020 Nov 02 04:07:30.371257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-238442c4-377c-4320-a2e0-551c0436603b req-8f4e5153-2052-41d2-8e03-9a9e839d7592 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036798 Nov 02 04:07:30.371852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1296/2587] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:07:31.205482 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:31.206358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:31.213265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:31.213746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:31.214189 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:31.214894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:31.215351 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:31.215779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:31.349799 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:31.357676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c3490340-7044-413c-9feb-a64b7436d7d1 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.157070 Nov 02 04:07:31.358239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1292/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:31 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:32.382295 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:32.382992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:32.390589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:32.391065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:32.391497 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:32.392227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:32.392679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:32.393101 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:32.536423 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:32.544834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ab5ca4dd-e518-4ec0-adec-39f121cb0758 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.167998 Nov 02 04:07:32.545594 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1297/2589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:32 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:33.568602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:33.569216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:33.575606 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:33.576131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:33.576566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:33.577800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:33.578251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:33.578676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:33.717252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:33.730346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d0c37bb0-414c-4fa4-b918-35391dca3e10 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.165375 Nov 02 04:07:33.731165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1293/2590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:33 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:34.755259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:34.755832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:34.762426 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:34.762907 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:34.763493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:34.764225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:34.765305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:34.765729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:34.903764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:34.911569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b6bd08f4-e3e1-4645-aeec-ea6a1303a212 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.160814 Nov 02 04:07:34.912139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1298/2591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:34 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:35.938681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:35.939297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:35.945694 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:35.946169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:35.946599 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:35.947282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:35.947726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:35.948181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:36.078015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:36.086932 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9c82c86e-816e-47f1-ba5c-19a1993d1a3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.152601 Nov 02 04:07:36.088363 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1294/2592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:35 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:36.270773 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f567e-4b62-4783-98b7-87f3691816ee", "name": "network-vif-plugged", "status": "completed", "tag": "6af2705a-7a13-41df-94e5-f277a5742334"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:36.281791 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:36.282271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:36.282908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:36.294571 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] Creating event network-vif-plugged:6af2705a-7a13-41df-94e5-f277a5742334 for instance 394f567e-4b62-4783-98b7-87f3691816ee on hv-cinder-86020 Nov 02 04:07:36.300330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-074cc33d-8f10-42c0-853e-a05791b73b91 req-98ac9aa5-b7f5-455e-875f-13be83406691 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Nov 02 04:07:36.301190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1299/2593] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:37.108685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:37.109536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:37.111703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:37.117006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:37.117488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:37.117923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:37.118615 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:37.119064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:37.119490 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:37.262765 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:37.270429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-89cf30e0-47ff-4aa5-b0c6-809a90790d19 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.165576 Nov 02 04:07:37.270992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1295/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:37 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:38.290710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:38.291647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:38.296177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:38.296872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:38.298609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:38.305694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:38.306245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:38.306679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:38.307357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:38.308183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:38.308609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:38.435595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:38.444647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2f9b8c0f-5487-400c-934c-904af560d4bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.155043 Nov 02 04:07:38.445359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1300/2595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:38 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:39.468652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:39.469269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:39.471153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:39.476717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:39.477197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:39.477638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:39.478320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:39.478769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:39.479192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:39.608300 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:39.615969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c934fc0-1ce9-482d-8342-2b7acbdc9707 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.151787 Nov 02 04:07:39.616551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1296/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:39 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:40.638676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:40.639289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:40.645624 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:40.646098 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:40.646526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:40.647228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:40.647678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:40.648137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:40.788768 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:40.797129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fd962726-5626-4faf-86be-08685f330c98 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1314 microversion: 2.1 time: 0.161598 Nov 02 04:07:40.797694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1301/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:40 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:41.819258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:41.820506 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:41.826334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:41.826814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:41.827251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:41.827991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:41.828448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:41.828875 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:42.080632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:42.089167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-71537197-7029-41f1-8052-90c2ce527a47 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1497 microversion: 2.1 time: 0.273699 Nov 02 04:07:42.089945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1297/2598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:41 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1497 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:42.761288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:42.761828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:42.768755 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:42.769239 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:42.769676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:42.770392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:42.770843 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:42.771266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:42.796626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:07:42.869191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a79a1f5b-aa99-4723-b5e9-26bb1a8349bf tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 204 len: 0 microversion: 2.1 time: 0.111437 Nov 02 04:07:42.869769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1302/2599] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:07:42 2022] DELETE /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:07:42.879314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:42.879940 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:42.886377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:42.886844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:42.887284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:42.887994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:42.888449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:42.888874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:43.031260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:43.040015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2ecdb2e7-8a00-48fa-9627-20ae40f5645d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1503 microversion: 2.1 time: 0.164711 Nov 02 04:07:43.040577 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1298/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:42 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:44.065793 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:44.066621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:44.072925 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:44.073408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:44.073844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:44.074558 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:44.075009 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:44.075433 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:44.212230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:44.220361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d2655558-8daa-4148-a63f-e05b239ef7f3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1503 microversion: 2.1 time: 0.159389 Nov 02 04:07:44.221051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1303/2601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:44 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:45.244130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:45.244739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:45.252158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:45.252641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:45.253287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:45.254168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:45.254774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:45.255348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:45.337226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:45.346114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c8470e6-232c-4c4e-be86-cb5f20e1614e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 200 len: 1461 microversion: 2.1 time: 0.105852 Nov 02 04:07:45.347998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1299/2602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:45 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:45.394583 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f567e-4b62-4783-98b7-87f3691816ee", "name": "network-vif-deleted", "tag": "6af2705a-7a13-41df-94e5-f277a5742334"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:45.404325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:45.404806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:45.405286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:45.417133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] Creating event network-vif-deleted:6af2705a-7a13-41df-94e5-f277a5742334 for instance 394f567e-4b62-4783-98b7-87f3691816ee on hv-cinder-86020 Nov 02 04:07:45.422875 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-796129ae-d236-4a7d-919e-1f6924ebaf2c req-018d0de2-0a18-456b-b0c6-d6eb9cff7a1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031863 Nov 02 04:07:45.423463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1304/2603] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:46.163441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1879132029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-459270510", "security_groups": [{"name": "tempest-secgroup-smoke-257612647"}], "networks": [{"uuid": "754d1829-aeef-46e5-9c26-fc2b818eac31"}], "block_device_mapping_v2": [{"uuid": "2075fd3d-367c-4aa9-afd6-6ba84b3530b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:46.277373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] validate_networks() for [('754d1829-aeef-46e5-9c26-fc2b818eac31', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:07:46.370031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:46.370660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 394f567e-4b62-4783-98b7-87f3691816ee] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:46.377399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:46.377895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:46.378335 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:46.379073 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:46.379529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:46.379969 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:46.394026 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] HTTP exception thrown: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Request method failure captured: Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee HTTP/1.1 Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYez9C9Y7SMsImwpxB4A2Tr5xNs3eIDTCW3wUIQsZfL2ZZmE7AuNskwQYGF8ilIQORqHLu4qT6CrYsMdjd1Ehxx6QCNmBd-e30oXry-nrPta9KX56QDtTOXECcJQ6uNYdjeskEPcVfEAqE1uXNM807R-Wxl4NLbRcX7gUD3GVBRGjWZE Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 7b9cca9a6f634ab4833986b65af4027f Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesActionsTest-490047275 Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:07:46.395710 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b9cca9a6f634ab4833986b65af4027f"}]}] Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesActionsTest-490047275 Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 7b9cca9a6f634ab4833986b65af4027f Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesActionsTest-490047275 Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesActionsTest-490047275-project Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7c13d0e399fb427284c900bf130f23a6 Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesActionsTest-490047275-project Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. Nov 02 04:07:46.398163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '394f567e-4b62-4783-98b7-87f3691816ee'} Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:07:46.399383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. Nov 02 04:07:46.401018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:07:46.402384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Returning 404 to user: Instance 394f567e-4b62-4783-98b7-87f3691816ee could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:07:46.402384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-229b250f-e047-4ff0-8fb2-edb245f4706b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee" status: 404 len: 111 microversion: 2.1 time: 0.031443 Nov 02 04:07:46.402384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1305/2604] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:46 2022] GET /compute/v2.1/servers/394f567e-4b62-4783-98b7-87f3691816ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 04:07:46.502536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1647422902", "imageRef": "c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f", "flavorRef": "452", "networks": [{"uuid": "5a5d1039-6163-4e2d-99d5-7050ed2dc691"}]}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:46.558546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] validate_networks() for [('5a5d1039-6163-4e2d-99d5-7050ed2dc691', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:07:46.886620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:07:46.887044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:07:46.887541 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:07:46.887991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:07:46.888411 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:07:46.897628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:46.898109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:46.898549 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:46.899274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:46.899734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:46.900187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:46.918112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Getting quotas for project 3e61d1b98c0b474a95a99962af8b20b5. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:07:46.924219 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Getting quotas for user 7f89c4e2fa8c495fa8bc7f64a3635fe0 and project 3e61d1b98c0b474a95a99962af8b20b5. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:07:46.984176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:07:46.986308 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2075fd3d-367c-4aa9-afd6-6ba84b3530b8',volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:07:47.042990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:07:47.043422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:07:47.043904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:07:47.044367 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:07:47.044784 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:07:47.053918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:47.054406 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:47.054851 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:47.055569 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:47.056050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:47.056484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:47.073650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Getting quotas for project 7b9cca9a6f634ab4833986b65af4027f. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:07:47.078288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Getting quotas for user 7c13d0e399fb427284c900bf130f23a6 and project 7b9cca9a6f634ab4833986b65af4027f. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:07:47.089704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:07:47.092066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8c1d7e7-c116-4c95-a4cf-d59288cf8a5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:07:47.119943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-fa1faec8-061c-422d-b273-ac00279d2382 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.960086 Nov 02 04:07:47.120685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1300/2605] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:07:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:07:47.139153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2725b873-77b1-478c-9134-ece46a4f63d2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:47.140705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2725b873-77b1-478c-9134-ece46a4f63d2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:47.152194 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2f66feaf-62dd-40aa-8cd3-729cdf2d4992 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653945 Nov 02 04:07:47.152550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1306/2606] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 04:07:47.164094 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-075e659a-b945-466f-9145-7f6a277310cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:47.164714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-075e659a-b945-466f-9145-7f6a277310cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:47.240907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2725b873-77b1-478c-9134-ece46a4f63d2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:47.254051 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-075e659a-b945-466f-9145-7f6a277310cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:47.254242 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2725b873-77b1-478c-9134-ece46a4f63d2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1088 microversion: 2.1 time: 0.122249 Nov 02 04:07:47.255004 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1301/2607] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:47 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1088 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:47.263457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-075e659a-b945-466f-9145-7f6a277310cb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1214 microversion: 2.1 time: 0.103033 Nov 02 04:07:47.273288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1307/2608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:47 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:48.277558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:48.278127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:48.284433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:48.284920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:48.285358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:48.286046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:48.286497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:48.286704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:48.287132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:48.287266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:48.293805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:48.295434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:48.295973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:48.297052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:48.297514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:48.298014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:48.360221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:48.370353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad3ad811-8b8a-4c98-981d-36ba9cf33faf tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1186 microversion: 2.1 time: 0.096452 Nov 02 04:07:48.371435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1302/2609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:48 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:48.391066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:48.403611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9d8a4a9-0776-4011-a577-0d1b98c75804 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1210 microversion: 2.1 time: 0.120711 Nov 02 04:07:48.404380 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1308/2610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:48 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:49.395716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:49.396857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:49.403926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:49.404570 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:49.419827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:49.422609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:49.423343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:49.424879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:49.427352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:49.427996 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:49.434830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:49.435566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:49.436204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:49.437155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:49.437779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:49.438365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:49.587167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:49.595890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f312fd05-9fb6-4bd8-9097-1071561cd5bb tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1272 microversion: 2.1 time: 0.172415 Nov 02 04:07:49.614721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1309/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:49 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:49.697625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:49.707690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8289c8de-62b9-4793-8c17-73d9fb0d76e0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1271 microversion: 2.1 time: 0.316221 Nov 02 04:07:49.712239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1303/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:49 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:50.299125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:50.308938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:50.309706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:50.310323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:50.322493 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] Creating event network-changed:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:07:50.327387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-ef54cc05-c94a-4aeb-8b0b-fe69947019e8 req-954bd514-cfbe-4505-843a-917f6b402b13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Nov 02 04:07:50.328017 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1310/2613] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:50.622530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:50.623109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:50.630271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:50.630753 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:50.631429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:50.632176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:50.632627 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:50.633046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:50.732917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:50.733684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:50.740491 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:50.741084 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:50.741604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:50.742413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:50.742946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:50.743449 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:51.088876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:51.093242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:51.097649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b966ce0b-930e-4f71-9cca-8707a0f8ee38 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.479064 Nov 02 04:07:51.098223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1304/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:50 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:51.102806 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee553d4-8bc3-4171-80a7-0274ef1aed12", "tag": "f16e4e86-4e12-4d6f-b992-c987ad4f07bb"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:51.103002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c3e4fd69-dff3-44c2-9a60-d3d81fb7f1a5 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.374629 Nov 02 04:07:51.104050 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1311/2615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:50 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:51.112904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:51.113369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:51.113792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:51.125093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] Creating event network-changed:f16e4e86-4e12-4d6f-b992-c987ad4f07bb for instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 on hv-cinder-86020 Nov 02 04:07:51.129890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-b6feb8f1-1a80-4ad2-8ccb-5b408256d39a req-c540343d-d2f8-40ed-a135-cb7b04fc4080 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Nov 02 04:07:51.130452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1305/2616] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:07:52.120943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:52.121567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:52.126643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:52.127342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:52.128665 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:52.129153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:52.129593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:52.130289 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:52.130741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:52.131161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:52.133325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:52.133826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:52.134258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:52.134934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:52.135380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:52.135802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:52.321199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:52.329359 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-887c4d94-2d64-436c-bce8-47b36e8f1d8b tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.212541 Nov 02 04:07:52.329922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1312/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:52 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:52.330184 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:52.338106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4c722a0c-fa94-489f-9f53-400a9be7e8c2 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.216371 Nov 02 04:07:52.338773 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1306/2618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:52 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:53.352361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:53.352968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:53.360128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:53.360595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:53.361019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:53.361019 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:53.361268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:53.361699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:53.362143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:53.362562 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:53.368517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:53.369005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:53.369473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:53.370178 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:53.370635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:53.371066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:53.558245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:53.562738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:53.565936 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5a866f3d-f30f-43c8-b479-dfde06700eaa tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.217429 Nov 02 04:07:53.566502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1313/2619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:53 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:53.570418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-85179111-81d2-4b7e-bad0-92f44c03ec63 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.214289 Nov 02 04:07:53.571039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1307/2620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:53 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:54.588842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:54.589494 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:54.592675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:54.593321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:54.596161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:54.596652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:54.597091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:54.597790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:54.598251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:54.598683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:54.599251 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:54.599738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:54.600224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:54.600916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:54.601368 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:54.601792 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:54.620223 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:54.816791 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:54.823479 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:54.827362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4494e5ce-c7c4-4aa4-98d3-f419f941a8b3 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.238356 Nov 02 04:07:54.828534 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1308/2621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:54 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:54.834083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a542097f-24b7-443a-abaa-f7593f282ba2 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.249231 Nov 02 04:07:54.834759 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1314/2622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:54 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:55.851771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:55.852436 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:55.859349 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:55.859511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:55.859979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:55.860269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:55.860424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:55.860992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:55.861447 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:55.861958 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:55.867471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:55.868083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:55.868477 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:55.869167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:55.869615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:55.870170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:56.064271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:56.067907 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:56.072342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4e72c984-069e-4517-becf-73c733693644 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.218120 Nov 02 04:07:56.086208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=100 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:56.086208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-71dcd448-692d-4cc8-acd9-06d81eefa6da tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.228444 Nov 02 04:07:56.086208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1309/2623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:55 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:56.086639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1315/2624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:55 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:56.391122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee553d4-8bc3-4171-80a7-0274ef1aed12", "name": "network-vif-plugged", "status": "completed", "tag": "f16e4e86-4e12-4d6f-b992-c987ad4f07bb"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:07:56.402122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:56.403200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:56.403641 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:56.414820 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] Creating event network-vif-plugged:f16e4e86-4e12-4d6f-b992-c987ad4f07bb for instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 on hv-cinder-86020 Nov 02 04:07:56.419795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-afc434d9-7856-429f-aa32-085b18dacd52 req-1bf4020f-c9b8-4017-92ef-5b10c1adaa33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033305 Nov 02 04:07:56.420408 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1310/2625] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:07:57.101640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:57.102280 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:57.103727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:57.104581 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:57.108204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:57.109222 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:57.110856 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:57.111351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:57.111799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:57.112866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:57.113343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:57.113771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:57.115199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:57.115680 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:57.116143 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:57.116832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:57.117283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:57.117703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:57.252660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=8 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:57.263551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=8 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:07:57.318237 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:57.326191 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:57.328387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-af9a8f10-3e40-4ac2-a3b8-f425315c351c tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.230647 Nov 02 04:07:57.328983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1316/2626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:57 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:57.333930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-57d1f9c2-c5c2-4dd0-8a95-324eb1f6a068 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.235441 Nov 02 04:07:57.334620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1311/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:57 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:07:58.358722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:58.360107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:58.360391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:58.361013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:58.369164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:58.369819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:58.370367 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:58.371176 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:58.371688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:58.372263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:58.389064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:58.389590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:58.390038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:58.390747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:58.391204 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:58.391662 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:58.579718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:58.583097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:58.587643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d2c312f1-7572-482c-a96f-e45e03ac6754 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.234611 Nov 02 04:07:58.588319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1312/2628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:58 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:58.590673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-2649f34f-6041-4eee-ae91-35d9f5d4329d tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1314 microversion: 2.1 time: 0.239330 Nov 02 04:07:58.591225 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1317/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:58 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:59.610636 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:59.611371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:59.613377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:07:59.613998 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:07:59.617908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:59.618393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:59.618894 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:59.655372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:59.655372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:59.655731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:59.655826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:59.655994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:59.655994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:59.655994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:07:59.655994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:07:59.656595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:07:59.821584 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:59.824787 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:07:59.829426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9de102c8-2fd5-4a29-a9c3-c50385affa6f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.222682 Nov 02 04:07:59.829995 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1313/2630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:59 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:07:59.833892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-86a7b19c-7bf2-4e5c-9689-71859d50d9c3 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1498 microversion: 2.1 time: 0.224212 Nov 02 04:07:59.834609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1318/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:07:59 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:08:00.386205 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:08:00.391661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:00.392323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:00.399344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.399850 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.400405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.401139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.401592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.402021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.402811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.403289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.403712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.415255 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] Creating event network-vif-plugged:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:08:00.422394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-bcb1f41b-6765-4d0f-9a0b-af4a206e01c4 req-5c628265-de31-48e0-9414-5b21e006db3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040634 Nov 02 04:08:00.423314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1314/2632] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:08:00.428595 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:08:00.517047 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fce5edd5-7ea4-4287-8964-034152fcaa3f tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 204 len: 0 microversion: 2.1 time: 0.134810 Nov 02 04:08:00.517628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1319/2633] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:08:00 2022] DELETE /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:08:00.526217 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:00.526919 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:00.533733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.534330 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.534927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.536019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.536638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.537066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.672383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:00.679986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-eaee9a1f-9d97-409c-80b5-999cb782622e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1504 microversion: 2.1 time: 0.157876 Nov 02 04:08:00.680552 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1315/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:00 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:00.852744 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:00.853450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:00.859809 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.860435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.860872 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.861553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:00.862005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:00.862430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:00.992567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:01.000877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ce089843-efaa-4056-89e1-85c7341b2b16 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.152337 Nov 02 04:08:01.001425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1320/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:00 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:01.702520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:01.703137 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:01.709480 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:01.709964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:01.710400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:01.711085 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:01.711538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:01.711973 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:01.839342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:01.847502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-18bba282-31b2-4983-8a64-989e781d3ca0 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1504 microversion: 2.1 time: 0.148890 Nov 02 04:08:01.848099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1316/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:01 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:02.024206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:02.024815 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:02.031776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:02.032272 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:02.032711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:02.033390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:02.033890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:02.034306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:02.161894 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:02.169660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a05e520f-8257-4457-b18a-be8cb3132b44 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.149428 Nov 02 04:08:02.170221 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1321/2637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:02 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:02.870026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:02.870643 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:02.878031 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:02.878521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:02.878971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:02.879664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:02.880173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:02.880601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:03.020075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:03.027817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2ed85328-dd41-4e73-b79b-870e42e20c9e tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1504 microversion: 2.1 time: 0.161686 Nov 02 04:08:03.028416 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1317/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:02 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:03.192195 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:03.192949 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:03.199434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:03.199921 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:03.200391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:03.201097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:03.201612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:03.202046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:03.264082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee553d4-8bc3-4171-80a7-0274ef1aed12", "name": "network-vif-deleted", "tag": "f16e4e86-4e12-4d6f-b992-c987ad4f07bb"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:08:03.273376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:03.273947 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:03.274669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:03.286498 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] Creating event network-vif-deleted:f16e4e86-4e12-4d6f-b992-c987ad4f07bb for instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 on hv-cinder-86020 Nov 02 04:08:03.291547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-2862cff0-9a77-48b6-8bd8-e5bc35c28be1 req-c8673380-e72b-4c7e-aa6f-742403dd419d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Nov 02 04:08:03.292252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1318/2639] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:08:03.355778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:03.364150 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ee74f2c9-8d65-4268-96cb-2456b6359e46 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1259 microversion: 2.1 time: 0.175873 Nov 02 04:08:03.364709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1322/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:03 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:04.055278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:04.055997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:04.062558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.062984 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.063419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.064140 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.064592 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.065014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.094783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.095253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.095688 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.096162 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lazy-loading 'fault' on Instance uuid 6ee553d4-8bc3-4171-80a7-0274ef1aed12 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:08:04.138048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c13d0e399fb427284c900bf130f23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9cca9a6f634ab4833986b65af4027f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:04.146333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e9863f9d-96b4-42c4-9a4a-8eaaf23a3b73 tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 200 len: 1304 microversion: 2.1 time: 0.095819 Nov 02 04:08:04.146892 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1319/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:04 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:04.386527 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:04.387139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:04.393500 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.393977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.394411 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.395093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.395544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.395988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.527647 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:04.536082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-afc0b01b-566f-4318-96ee-1f74f43d172d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1443 microversion: 2.1 time: 0.153428 Nov 02 04:08:04.536643 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1323/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:04 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:04.558193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:04.558800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:04.565084 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.565558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.565990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.566664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:04.567108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:04.567528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:04.693302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:08:04.701547 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-dd084b48-5fc9-4772-8b69-90338eb10453 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1443 microversion: 2.1 time: 0.147213 Nov 02 04:08:04.702278 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1320/2643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:04 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:08:05.169704 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:08:05.170450 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] [instance: 6ee553d4-8bc3-4171-80a7-0274ef1aed12] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:08:05.176533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:05.177021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:05.177459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:05.178157 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:05.178613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:05.179034 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:05.192472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] HTTP exception thrown: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Request method failure captured: Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 HTTP/1.1 Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYez9C9Y7SMsImwpxB4A2Tr5xNs3eIDTCW3wUIQsZfL2ZZmE7AuNskwQYGF8ilIQORqHLu4qT6CrYsMdjd1Ehxx6QCNmBd-e30oXry-nrPta9KX56QDtTOXECcJQ6uNYdjeskEPcVfEAqE1uXNM807R-Wxl4NLbRcX7gUD3GVBRGjWZE Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 7b9cca9a6f634ab4833986b65af4027f Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesActionsTest-490047275 Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:08:05.194061 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b9cca9a6f634ab4833986b65af4027f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b9cca9a6f634ab4833986b65af4027f"}]}] Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesActionsTest-490047275 Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 7b9cca9a6f634ab4833986b65af4027f Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesActionsTest-490047275 Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesActionsTest-490047275-project Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7c13d0e399fb427284c900bf130f23a6 Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesActionsTest-490047275-project Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. Nov 02 04:08:05.195151 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '6ee553d4-8bc3-4171-80a7-0274ef1aed12'} Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:08:05.195725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. Nov 02 04:08:05.197178 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:08:05.198126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] Returning 404 to user: Instance 6ee553d4-8bc3-4171-80a7-0274ef1aed12 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:08:05.198126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-14ddd15e-797d-4e7d-adc3-fdecf852c0ff tempest-VolumesActionsTest-490047275 tempest-VolumesActionsTest-490047275-project] 10.222.0.26 "GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12" status: 404 len: 111 microversion: 2.1 time: 0.029680 Nov 02 04:08:05.198126 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1324/2644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:08:05 2022] GET /compute/v2.1/servers/6ee553d4-8bc3-4171-80a7-0274ef1aed12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:08:06.593466 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:08:06.602943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:08:06.603433 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:08:06.603834 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:08:06.615320 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] Creating event network-changed:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:08:06.620145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-1110ea61-6a7b-4ae1-aced-9018920969c0 req-b60642c4-54d2-4fd7-b70d-70e1ec821ea2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030279 Nov 02 04:08:06.620720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1321/2645] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:09:23.481861 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:23.482679 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:23.487565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0edbe125-7d8e-48b1-a2f6-78b077d99cfa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'create', calling method: .version_select at 0x7f5c931e89d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1727781910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaOZz8zqNpIKPkW5CxgrhdUCl02YQGI108UIyW6bkp7qTz7IYnM16wYxAGxGSRgIVp97CnnIIZmRnkLv9TEV4/v5dwM4mj8fMCS3F6OgPQGBaarQkP5ntjpezesc1Ee5A=="}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:23.507865 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-0edbe125-7d8e-48b1-a2f6-78b077d99cfa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Getting quotas for project 561a9720212b46e2bb93367218e0f112. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:09:23.511858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-0edbe125-7d8e-48b1-a2f6-78b077d99cfa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Getting quotas for user 8b56999a02524408b74371e6f8d158cf and project 561a9720212b46e2bb93367218e0f112. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:09:23.534551 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0edbe125-7d8e-48b1-a2f6-78b077d99cfa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054872 Nov 02 04:09:23.535144 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1325/2646] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 04:09:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:09:23.584786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:23.585523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=58 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:23.592080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1406619117", "imageRef": "d35da670-5f0c-4d99-9c87-d3a594d264e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1727781910", "networks": [{"uuid": "46a2994b-5bb0-40e9-9712-32841b52335e"}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:23.644452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] validate_networks() for [('46a2994b-5bb0-40e9-9712-32841b52335e', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:09:24.007092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:09:24.007545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:09:24.008048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:09:24.008462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:09:24.008872 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:09:24.017601 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:24.018081 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:24.018521 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:24.019254 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:24.019710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:24.020167 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:24.037289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Getting quotas for project 561a9720212b46e2bb93367218e0f112. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:09:24.041288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Getting quotas for user 8b56999a02524408b74371e6f8d158cf and project 561a9720212b46e2bb93367218e0f112. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:09:24.052750 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:09:24.055041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d35da670-5f0c-4d99-9c87-d3a594d264e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:09:24.098971 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-df2b9b64-d22c-48d2-aa85-dc9ab2957eca tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516359 Nov 02 04:09:24.099844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1322/2647] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:09:24.110900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5737624e-3711-4a2a-97b5-fbab17776ea9 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:24.112439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5737624e-3711-4a2a-97b5-fbab17776ea9 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:24.169712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5737624e-3711-4a2a-97b5-fbab17776ea9 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:24.177908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5737624e-3711-4a2a-97b5-fbab17776ea9 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1259 microversion: 2.1 time: 0.071108 Nov 02 04:09:24.178459 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1326/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:24 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:25.201229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:25.201775 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:25.208057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:25.208540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:25.208978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:25.209662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:25.210112 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:25.210538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:25.273331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:25.281144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bc99b4d3-193c-4814-b445-42ce04c21258 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1311 microversion: 2.1 time: 0.084342 Nov 02 04:09:25.281711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1323/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:25 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:26.303824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:26.305696 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:26.323176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:26.324108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:26.325001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:26.326542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:26.327281 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:26.328023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:26.488442 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:26.497175 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-342e88da-f11a-4ed8-8ee6-b691472bd1d7 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.197744 Nov 02 04:09:26.500013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1327/2650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:26 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:27.535718 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:27.536399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:27.542712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:27.543187 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:27.543631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:27.544352 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:27.544814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:27.545233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:27.686295 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:27.695146 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-629e21ab-db1f-43a3-a47f-6211b812b46b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.163084 Nov 02 04:09:27.696310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1324/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:27 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:28.717906 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:28.718561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:28.725128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:28.725629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:28.726062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:28.726752 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:28.727202 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:28.727625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:28.871008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:28.879166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8aad5112-2661-453f-8d3c-99acfeeda152 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.165067 Nov 02 04:09:28.879983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1328/2652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:28 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:29.902630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:29.904115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:29.912041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:29.912594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:29.913106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:29.913864 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:29.914400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:29.914888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:30.053517 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:30.069513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-695a4acc-273a-4bbf-bf80-01d319b8cb39 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.170719 Nov 02 04:09:30.070523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1325/2653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:29 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:31.094235 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:31.095717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:31.104944 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:31.105977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:31.106576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:31.107434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:31.108191 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:31.108778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:31.248699 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:31.256753 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3cc18a58-91ae-469c-812e-0756e6d1ad74 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.167678 Nov 02 04:09:31.257305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1329/2654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:31 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:32.279815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:32.281190 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:32.289014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:32.289801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:32.290441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:32.291345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:32.292012 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:32.292631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:32.448793 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:32.457168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-62c38ef8-7360-4282-853e-7af93ea1c0ea tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.180758 Nov 02 04:09:32.457730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1326/2655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:32 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:33.480763 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:33.481412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:33.488625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:33.489117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:33.489561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:33.490645 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:33.490750 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:33.493372 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:33.632472 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:33.640256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3117b914-bce5-444e-93a1-c7a28058e6f5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.163405 Nov 02 04:09:33.640823 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1330/2656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:33 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:34.662844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:34.663460 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:34.665790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:34.666484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:34.671719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:34.672231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:34.672665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:34.673348 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:34.673827 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:34.674253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:34.806860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:34.814597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4d814297-2d3b-479f-876c-008c35afb736 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.155703 Nov 02 04:09:34.815170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1327/2657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:34 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:35.371797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=6 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:35.512262 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:35.521842 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:35.522317 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:35.522747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:35.534229 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] Creating event network-changed:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:09:35.539762 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-b407924d-e33a-415f-8213-e4389ba10258 req-7e887273-abb7-4f4b-b8f2-e0ebe0ee12a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172448 Nov 02 04:09:35.540385 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1331/2658] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:09:35.837015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:35.837745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:35.843897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:35.844404 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:35.844839 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:35.845531 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:35.845982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:35.846413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:35.976991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:35.984620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b720e3d6-adce-4300-9c60-666c734de632 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.151568 Nov 02 04:09:35.985180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1328/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:35 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:09:37.008504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:37.009205 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:37.015756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:37.016271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:37.016706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:37.017387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:37.017857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:37.018277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:37.147208 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:37.156123 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-88dbcddc-752b-4106-8bc7-2c701d22f90b tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.152441 Nov 02 04:09:37.156707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1332/2660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:37 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:38.179532 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:38.180172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:38.186565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:38.187045 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:38.187471 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:38.188179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:38.188625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:38.189073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:38.317556 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:38.325147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f2ee2508-210b-41fc-ae0a-471a0b76b235 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.149465 Nov 02 04:09:38.325703 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1329/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:38 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:39.347405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:39.348078 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:39.354484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:39.354971 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:39.355444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:39.356171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:39.356627 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:39.357057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:39.488360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:39.495827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-53dd8108-1d9b-41ef-a1df-d7d39a8b7745 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.152321 Nov 02 04:09:39.496410 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1333/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:39 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:40.517445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:40.518064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:40.525079 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:40.525821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:40.526271 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:40.526960 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:40.527419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:40.527844 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:40.656448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:40.664619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-05a584c6-cfd7-4280-ad1a-11a75b61cc12 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.151005 Nov 02 04:09:40.665186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1330/2663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:40 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:09:41.686695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:41.687309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:41.694354 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:41.694833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:41.695267 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:41.695976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:41.696425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:41.696849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:41.848626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "name": "network-vif-plugged", "status": "completed", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:41.856201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:41.858692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:41.859185 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:41.859983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:41.864721 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-87f05403-1921-4a41-ab97-9ab29b4df00a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.181893 Nov 02 04:09:41.865287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1334/2664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:41 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:41.871354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] Creating event network-vif-plugged:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:09:41.877252 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-9d432147-f055-4da1-8556-56a7d33c6ee1 req-abc296d2-cca4-4c47-90dc-bfeeacbb5df3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115177 Nov 02 04:09:41.877821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1331/2665] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:09:42.886441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:42.887062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:42.893418 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:42.893899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:42.894337 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:42.895656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:42.896146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:42.896576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:43.026228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:43.033818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-82d06535-bb4a-4781-a79c-b27c3d3f429c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1359 microversion: 2.1 time: 0.151172 Nov 02 04:09:43.034374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1335/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:42 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:44.058370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:44.059064 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:44.065449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.065936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.066488 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.067720 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.068197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.068617 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.198323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:44.206166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-95a07164-29a6-4ede-96f6-90bf09250082 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1550 microversion: 2.1 time: 0.152427 Nov 02 04:09:44.206721 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1332/2667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:44 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:44.228736 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:44.229366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:44.235778 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.236308 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.236751 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.237443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.237901 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.238946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.362656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:44.370405 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-30bd1d94-a9ab-4e86-8101-01aeeebd49d3 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1550 microversion: 2.1 time: 0.145487 Nov 02 04:09:44.370970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1336/2668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:44 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:44.392565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:44.398039 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:44.398744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Searching by: {'deleted': False, 'project_id': '561a9720212b46e2bb93367218e0f112'} {{(pid=125410) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 04:09:44.405192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.405652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.406080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.406789 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.407234 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.407656 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.498277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.multi_cell_list [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 04:09:44.589890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a0de8378-47d3-48ee-9294-70eb5a1c93bf tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201197 Nov 02 04:09:44.590468 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1333/2669] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Nov 2 04:09:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:09:44.602013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:44.602635 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:44.608533 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.609021 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.609465 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.610155 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:44.610611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:44.611040 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:44.738986 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:44.746813 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8bf3acaf-c069-4462-a1ce-486cfa40f4a1 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1550 microversion: 2.1 time: 0.148608 Nov 02 04:09:44.747387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1337/2670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:44 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:46.307346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c65b3675-1525-41be-be24-04a01d6c5200"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:46.309702 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:46.316196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:46.317266 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:46.317724 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:46.318402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:46.318850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:46.319268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:46.580512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6a5eadfa-84f6-4801-acf8-4c976563d842 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276575 Nov 02 04:09:46.581118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1334/2671] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Nov 2 04:09:46 2022] POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:09:54.165232 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:54.165858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:54.168399 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:54.174309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:54.174819 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:54.175258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:54.175975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:54.177005 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:54.177435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:54.180834 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=63 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:54.400913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:54.409198 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-386ee4de-5b1f-4ff4-bfcb-1fe0ea957d08 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1596 microversion: 2.1 time: 0.248395 Nov 02 04:09:54.409769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1338/2672] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:54 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1596 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:56.242625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:56.303937 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:56.310281 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:56.317989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:56.318591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:56.319391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:56.323897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:09:56.334109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] Creating event network-changed:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:09:56.340734 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-31dfb2e0-a363-40ae-b490-9f8ebc206720 req-b741d16f-86d4-455e-aa20-dd99c215597e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102615 Nov 02 04:09:56.341712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1335/2673] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:09:57.414164 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1284353500"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:57.414698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:57.420707 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:57.421187 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:57.421628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:57.422315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:57.422761 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:57.423180 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:57.561747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.network.security_group_api [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Adding security group 90e446f1-7fb0-482b-9328-d2a9b5481b31 to port e4f6cb9a-1cd8-496a-a694-fe91d3211483 Nov 02 04:09:57.881685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c98d75c8-0df2-4406-8120-619a1a47c25e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action" status: 202 len: 0 microversion: 2.1 time: 0.471654 Nov 02 04:09:57.882321 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1339/2674] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 04:09:57 2022] POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:09:57.891640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:09:57.892550 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:09:57.900719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:57.901128 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:57.901561 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:57.902518 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:57.902712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:57.903126 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:58.046640 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:09:58.055409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c2104e50-80bd-407d-b313-5aea43c0c527 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1762 microversion: 2.1 time: 0.168225 Nov 02 04:09:58.056009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1336/2675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:09:57 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:09:58.356106 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:09:58.365589 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:09:58.366096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:09:58.366531 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:09:58.377678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] Creating event network-changed:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:09:58.383246 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-9d0ce58c-1913-4ee7-8e1c-6b8af661c74e req-7726b0a2-4437-4ea2-8609-59a9ec594fd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030845 Nov 02 04:09:58.383835 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1340/2676] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:10:11.756931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:10:11.757451 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:11.759979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:11.760632 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=7 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:11.766736 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:11.767247 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:11.767684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:11.768402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:11.768856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:11.769280 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:11.791265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lazy-loading 'flavor' on Instance uuid f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:10:11.860545 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-4f60b57c-bc4e-41c3-bad4-e247b5739c09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "POST /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77/action" status: 202 len: 0 microversion: 2.1 time: 0.107983 Nov 02 04:10:11.861152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1337/2677] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 04:10:11 2022] POST /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:10:11.867620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=5 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:11.868393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=11 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:11.872713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:11.873685 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:11.880888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:11.881365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:11.881794 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:11.882486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:11.882933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:11.883355 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:12.017640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:12.025271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e793943f-e55a-42e4-9d5d-85fcd7d56540 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.159111 Nov 02 04:10:12.025828 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1341/2678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:11 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:13.049591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:13.050331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:13.056410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:13.056890 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:13.057326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:13.058006 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:13.058455 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:13.058877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:13.186383 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:13.194116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-25309ac0-b52e-4f5e-aaab-2f252696645e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.149214 Nov 02 04:10:13.194677 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1338/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:13 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:14.217041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:14.217653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:14.224033 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:14.224517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:14.224951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:14.225636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:14.226089 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:14.226510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:14.355577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:14.363216 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-98b4b0a0-9049-47b6-9b41-70edde867598 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.149995 Nov 02 04:10:14.363779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1342/2680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:14 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:15.386469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:15.387087 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:15.393513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:15.393990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:15.394945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:15.395626 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:15.396107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:15.396537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:15.523076 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:15.530811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d5b83fc-d4f7-4169-9e55-12220951133e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.148164 Nov 02 04:10:15.531378 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1339/2681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:15 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:16.554299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:16.554911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:16.561296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:16.561776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:16.562227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:16.562911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:16.563365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:16.563788 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:16.689265 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:16.697460 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ebce9b91-7c56-4fa6-9deb-bb6413c3a904 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.147030 Nov 02 04:10:16.698023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1343/2682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:16 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:17.720226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:17.720835 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:17.727825 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:17.728323 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:17.728749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:17.729419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:17.729860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:17.730275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:17.860987 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:17.868559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b95e16fa-2dfe-48f8-be06-7a44ad3742f4 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.152188 Nov 02 04:10:17.869114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1340/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:17 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:18.892694 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:18.893213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:18.899628 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:18.900143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:18.900588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:18.901274 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:18.901727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:18.902153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:19.033529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:19.042091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-27c10f68-c63f-4819-a35f-e602de60b238 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.153342 Nov 02 04:10:19.042654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1344/2684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:18 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:20.064710 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:20.065339 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:20.071707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.072229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.072664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.073345 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.073796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.074216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.206797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:20.214991 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-904bc908-91c2-4c4b-9aae-b730afec9327 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.154002 Nov 02 04:10:20.215536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1341/2685] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:20 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:20.624361 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:10:20.626664 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:20.633653 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.634139 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.634580 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.635269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.635723 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.636258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.705676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-753418e7-7c4d-4749-b46a-e13f6febb33e tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action" status: 202 len: 0 microversion: 2.1 time: 0.085302 Nov 02 04:10:20.706368 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1345/2686] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 04:10:20 2022] POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:10:20.714356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:20.714965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:20.720739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.721283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.721860 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.722690 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:20.723204 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:20.723628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:20.866474 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:20.874870 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d37680db-495a-4e45-bfc1-dc435e12d75a tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1754 microversion: 2.1 time: 0.164330 Nov 02 04:10:20.875437 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1342/2687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:20 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:21.238357 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:21.239171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:21.245954 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:21.246680 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:21.247190 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:21.248256 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:21.248776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:21.249266 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:21.382999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:21.390631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8c9e2798-0b3e-4b0e-8f53-82c45aa6242f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.156557 Nov 02 04:10:21.391213 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1346/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:21 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:21.898611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:21.899224 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:21.905709 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:21.906179 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:21.906610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:21.907293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:21.907739 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:21.908195 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:22.046048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:22.054133 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-58125703-2f5d-4d02-a1d3-c8b56c7478f4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.159907 Nov 02 04:10:22.054695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1343/2689] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:21 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:22.414165 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:22.414816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:22.421490 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:22.421972 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:22.422408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:22.423095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:22.423544 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:22.423982 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:22.556189 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:22.563979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4520e08b-ac30-4548-9591-51e228942626 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.153645 Nov 02 04:10:22.564563 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1347/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:22 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:23.077222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:23.077832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:23.084216 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:23.084689 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:23.085120 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:23.085798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:23.086245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:23.086665 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:23.226722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:23.246492 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-12bf557a-4f7f-4bdf-85cf-38020e8b1d64 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.173095 Nov 02 04:10:23.251307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1344/2691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:23 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:23.587993 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:23.588613 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:23.595024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:23.595536 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:23.595995 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:23.596684 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:23.597137 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:23.597565 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:23.725650 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:23.733269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-92d3ee16-b3ff-493d-9ed0-989e9c20d6bb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.149128 Nov 02 04:10:23.733859 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1348/2692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:23 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:24.269748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:24.270358 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:24.277250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:24.277727 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:24.278406 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:24.279083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:24.279530 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:24.279965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:24.426130 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:24.435035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-00540f0b-85af-4c2d-b2d6-233b08a50e3d tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.169235 Nov 02 04:10:24.435676 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1345/2693] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:24 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:24.757291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:24.757945 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:24.764631 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:24.765117 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:24.765572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:24.766257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:24.766713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:24.767141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:24.900307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:24.908300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-45686a51-b3be-42df-a9aa-59b341954a24 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.155709 Nov 02 04:10:24.908899 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1349/2694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:24 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:25.459767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:25.460429 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:25.466883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:25.467355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:25.467783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:25.468483 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:25.468928 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:25.469346 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:25.612711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:25.620837 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c2739aae-39b8-4f94-b078-6f9854e03fc4 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.165755 Nov 02 04:10:25.621399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1346/2695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:25 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:25.932294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:25.932837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:25.939097 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:25.939578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:25.940042 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:25.940725 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:25.941177 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:25.941603 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.071250 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:26.078824 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1d6e3eb1-46e1-4900-aa19-f74e80105fec tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1509 microversion: 2.1 time: 0.150496 Nov 02 04:10:26.079391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1350/2696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:25 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:26.101225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:10:26.101810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:26.107560 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.108062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.108493 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.109159 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.109602 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.110017 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.150343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125410) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 04:10:26.214274 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5e965728-53e5-498f-b4dc-56394b5b616c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "POST /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77/action" status: 202 len: 0 microversion: 2.1 time: 0.117267 Nov 02 04:10:26.214883 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1347/2697] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 04:10:26 2022] POST /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:10:26.222846 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:26.223539 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:26.230382 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.230940 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.231451 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.232251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.232880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.233310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.375351 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:26.383286 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e1ca3aaa-7e8f-4cbd-8fe9-c213cc7af28a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1517 microversion: 2.1 time: 0.164206 Nov 02 04:10:26.384058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1351/2698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:26 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:26.645166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:26.646284 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:26.652462 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.652943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.653380 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.654065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:26.654512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:26.654933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:26.801496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:26.810287 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a8a7c7a9-325b-4411-a83f-f57064d9bc61 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.169375 Nov 02 04:10:26.810850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1348/2699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:26 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:27.410339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:27.410958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:27.417407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:27.417786 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:27.418528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:27.419344 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:27.419852 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:27.420330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:27.555446 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:27.563353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-059dd8dc-d591-41a1-9ef3-1f3fe7be2783 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1519 microversion: 2.1 time: 0.157009 Nov 02 04:10:27.563855 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1352/2700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:27 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:27.834243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:27.835403 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:27.842015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:27.842494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:27.842926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:27.843611 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:27.844082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:27.844503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:27.906890 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "name": "network-vif-unplugged", "status": "completed", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:10:27.918508 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:27.919238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:27.919670 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:27.935435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.compute.server_external_events [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] Unable to find a host for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77. Dropping event network-vif-unplugged {{(pid=125411) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 04:10:27.936540 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-1ce6aa51-28ba-4b9e-b672-bc025b1d48ae req-7e5c9ee4-146a-4ba7-bc16-010cf45c303e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033770 Nov 02 04:10:27.937795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1353/2701] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 04:10:28.005366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:28.014373 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-bf8901f3-dee1-4cd5-852b-b1e2261e8936 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.184002 Nov 02 04:10:28.014982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1349/2702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:27 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:28.586961 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:28.587584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:28.594038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:28.594526 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:28.594970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:28.595667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:28.596158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:28.596590 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:28.733968 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:28.742530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c969a253-b895-4dbd-ab95-ded712f7621c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.159873 Nov 02 04:10:28.743111 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1354/2703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:28 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:29.038769 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:29.039500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:29.046442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:29.046917 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:29.047354 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:29.048060 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:29.048509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:29.048931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:29.069154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:29.195583 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:29.203803 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-38c4dc65-4d51-4a9d-873f-a6d602cd0735 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.169493 Nov 02 04:10:29.204503 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1350/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:29 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:29.767008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:29.767646 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:29.774644 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:29.775122 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:29.775552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:29.776255 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:29.776702 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:29.777119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:29.904866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:29.913014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a4a04097-9a4c-4742-8ee2-0748c95da60c tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.150127 Nov 02 04:10:29.913579 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1355/2705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:29 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:30.227016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:30.227629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:30.234023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:30.234504 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:30.234933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:30.235614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:30.236115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:30.236528 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:30.379025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:30.387717 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6d537988-b2d7-4851-8c87-f3ef327a8dbe tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.164501 Nov 02 04:10:30.388309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1351/2706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:30 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:30.936066 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:30.936779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:30.943315 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:30.943858 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:30.944303 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:30.944988 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:30.945434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:30.945853 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:31.073814 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:31.081534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9197603-80f0-407f-acef-6a01d18e186d tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.149326 Nov 02 04:10:31.082093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1356/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:30 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:31.410154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:31.410763 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:31.417170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:31.417637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:31.418067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:31.418802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:31.419249 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:31.419670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:31.559307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:31.567439 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c129d009-a0a6-448f-bb4b-4d3c5ee06602 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.161230 Nov 02 04:10:31.568119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1352/2708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:31 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:32.105502 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:32.106119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:32.112902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:32.113389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:32.113830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:32.114547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:32.114997 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:32.116114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:32.120307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:32.247427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:32.255435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0b202479-bef6-4de5-8253-bf892790c4f8 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.153888 Nov 02 04:10:32.256028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1357/2709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:32 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:32.591048 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:32.591660 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:32.598181 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:32.598659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:32.599093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:32.600448 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:32.600900 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:32.601321 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:32.744088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:32.752990 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-de76f154-5dbf-41c0-8f76-752b0202f6c5 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1759 microversion: 2.1 time: 0.165765 Nov 02 04:10:32.753814 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1353/2710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:32 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:33.278316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:33.278937 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:33.285432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:33.285916 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:33.286356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:33.287045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:33.287501 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:33.287929 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:33.421271 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:33.429509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-21b6a37e-09f3-44c2-814b-444873eaa47b tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.155165 Nov 02 04:10:33.430071 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1358/2711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:33 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:33.778009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:33.778691 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:33.784957 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:33.785430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:33.785862 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:33.786537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:33.786978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:33.788040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:33.929682 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:33.937800 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-253a865f-d87a-4e8e-a560-f4b0731dec98 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1762 microversion: 2.1 time: 0.163622 Nov 02 04:10:33.938366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1354/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:33 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1762 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:34.452830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:34.453445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:34.460625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:34.461108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:34.461550 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:34.462241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:34.462690 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:34.463113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:34.594356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:34.601952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a5098412-8b50-4a18-905b-83ca8a6614d0 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.153015 Nov 02 04:10:34.602510 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1359/2713] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:34 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:35.627604 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:35.628170 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:35.635269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:35.635749 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:35.636222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:35.636911 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:35.637359 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:35.637781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:35.763174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:35.770810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a4fe4ea7-55a9-4152-a20e-69bc7e8a380a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.148277 Nov 02 04:10:35.771985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1355/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:35 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:36.794028 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:36.794611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:36.801036 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:36.801516 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:36.801952 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:36.803252 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:36.803711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:36.804168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:36.933686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:36.941701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-297a6244-ec3c-455b-a6db-38450184505e tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.151580 Nov 02 04:10:36.942268 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1360/2715] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:36 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:37.965067 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:37.965670 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:37.972035 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:37.972513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:37.972938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:37.973624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:37.974065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:37.975134 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:38.122728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:38.131241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-54112f26-2d74-4ff5-8905-c69b0b41c15f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.169496 Nov 02 04:10:38.131821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1356/2716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:37 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:39.156888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:39.157506 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:39.163879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:39.164397 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:39.164832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:39.165511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:39.165965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:39.166391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:39.294143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:39.301757 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f29afeae-297f-4208-813d-daad2733db09 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.148645 Nov 02 04:10:39.302343 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1361/2717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:39 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:40.009994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:10:40.020093 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:40.020639 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:40.021153 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:40.033851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] Creating event network-vif-plugged:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:10:40.039648 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-4444707d-49a2-40d6-8775-91f875dc4acf req-c0493dd1-e3bb-4ddf-8eb4-311964fda6bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033632 Nov 02 04:10:40.040264 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1357/2718] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:10:40.325447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:40.326064 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:40.332584 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:40.333067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:40.333507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:40.334770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:40.335228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:40.335656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:40.465741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:40.473435 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-212c841c-1881-41a9-abbd-178594afd36f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.151913 Nov 02 04:10:40.474287 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1362/2719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:40 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:41.497536 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:41.498398 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:41.505337 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:41.506454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:41.506885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:41.507559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:41.508024 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:41.508446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:41.634268 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:41.641828 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ff139e6c-b348-438e-a5db-1b8c8b5732db tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1575 microversion: 2.1 time: 0.148582 Nov 02 04:10:41.642422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1358/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:41 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:10:42.665264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:10:42.665876 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:10:42.668220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=45 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:10:42.673353 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:42.673829 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:42.674263 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:42.674943 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:10:42.675392 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:10:42.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:10:42.802352 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:10:42.810535 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-487f5502-e9e1-42f5-ae33-c50c1ed6baed tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1562 microversion: 2.1 time: 0.149755 Nov 02 04:10:42.811087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1363/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:10:42 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:11:01.276856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:01.277410 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:01.279442 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:11:01.280106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=46 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:11:01.286948 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:01.287929 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:01.288384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:01.289066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:01.289511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:01.289927 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:01.303655 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] HTTP exception thrown: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Request method failure captured: Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 HTTP/1.1 Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUZ-fPFk7sc6-KadH5w-n2PGiuKQxVTTwke0NpgCpj-9hGMY94Xvaminm4-Rp6C-G7AAL8PVK4A0t7h-Gj2-5J0nzQQQ9_kMmnK0mT7hwIcJF9TuqMVgtEs0-F6uy_wO6IC9NDxP_d-TQgEWj6a3ULQTbHAMOWm4mfQOnRWOjnQZpY Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:11:01.305288 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}] Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 18355f4225c9427dbb38fde84115d7b2 Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.306596 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '68620f31-6b17-41c5-9c0f-48ac66097f04'} Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:11:01.307305 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.308629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.310075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Returning 404 to user: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:11:01.310075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8776482d-6bb3-47e3-a553-ba521c00172f tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 404 len: 111 microversion: 2.1 time: 0.033802 Nov 02 04:11:01.310075 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1359/2722] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:11:01 2022] DELETE /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:11:01.315152 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:01.315776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] [instance: 68620f31-6b17-41c5-9c0f-48ac66097f04] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:01.318158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:11:01.318845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=40 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:11:01.323910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:01.324428 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:01.324873 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:01.325577 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:01.326588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:01.326588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:01.341220 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] HTTP exception thrown: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Request method failure captured: Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 HTTP/1.1 Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUZ-fPFk7sc6-KadH5w-n2PGiuKQxVTTwke0NpgCpj-9hGMY94Xvaminm4-Rp6C-G7AAL8PVK4A0t7h-Gj2-5J0nzQQQ9_kMmnK0mT7hwIcJF9TuqMVgtEs0-F6uy_wO6IC9NDxP_d-TQgEWj6a3ULQTbHAMOWm4mfQOnRWOjnQZpY Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:11:01.342879 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85403204e27c40ffb0155dd8aba3d77b"}]}] Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 85403204e27c40ffb0155dd8aba3d77b Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeTestJSON-321394069 Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 18355f4225c9427dbb38fde84115d7b2 Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeTestJSON-321394069-project Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.344496 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '68620f31-6b17-41c5-9c0f-48ac66097f04'} Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:11:01.345441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. Nov 02 04:11:01.347053 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:01.348511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] Returning 404 to user: Instance 68620f31-6b17-41c5-9c0f-48ac66097f04 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:11:01.348511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ba44589c-df2f-40ae-b0dc-c33df6bf74c8 tempest-AttachVolumeTestJSON-321394069 tempest-AttachVolumeTestJSON-321394069-project] 10.222.0.26 "GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04" status: 404 len: 111 microversion: 2.1 time: 0.032953 Nov 02 04:11:01.348511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1364/2723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:11:01 2022] GET /compute/v2.1/servers/68620f31-6b17-41c5-9c0f-48ac66097f04 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:11:05.577027 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:11:05.577544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.26) !!! Nov 02 04:11:05.709020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-03c3d7be-c28e-4159-89c8-9d4f3826664e tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Action: 'create', calling method: .version_select at 0x7f5c924918b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-302358364", "metadata": {"Type": "work"}}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:11:06.010158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-03c3d7be-c28e-4159-89c8-9d4f3826664e tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.438116 Nov 02 04:11:06.011015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1360/2724] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 04:11:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 02 04:11:06.024226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-63e76978-b568-4550-a326-23e249e5b959 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c924abee0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:06.032046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:11:06.032350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:11:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 (ip 10.222.0.26) !!! Nov 02 04:11:06.079402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-63e76978-b568-4550-a326-23e249e5b959 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 200 len: 352 microversion: 2.1 time: 0.059254 Nov 02 04:11:06.080311 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1365/2725] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:11:06 2022] GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:11:06.569324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1284353500"}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:11:06.569854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:06.575817 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:06.576319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:06.576746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:06.577415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:06.577916 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:06.578270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:06.711013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.network.security_group_api [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Removing security group 90e446f1-7fb0-482b-9328-d2a9b5481b31 from port e4f6cb9a-1cd8-496a-a694-fe91d3211483 Nov 02 04:11:07.008884 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7ed7dab9-48d8-42ab-a1ee-e5a0832dff30 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action" status: 202 len: 0 microversion: 2.1 time: 0.443443 Nov 02 04:11:07.009510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1361/2726] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Nov 2 04:11:06 2022] POST /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:11:07.018468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:11:07.029432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:07.030058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:07.030597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:07.042464 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] Creating event network-changed:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:11:07.047902 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-20caed42-3d32-4269-be4f-dcbcbe548630 req-c4c9ebae-39c3-45e3-950f-6d09fc987fc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032973 Nov 02 04:11:07.049119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1366/2727] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:11:07.094169 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad72eda9-1fb0-49d9-a334-ab1d2fc2f427 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c923fc430>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:07.150487 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad72eda9-1fb0-49d9-a334-ab1d2fc2f427 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 200 len: 353 microversion: 2.1 time: 0.059863 Nov 02 04:11:07.151637 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1362/2728] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:11:07 2022] GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:11:07.165695 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b5baf69d-0938-439e-b297-151ef3c8acb5 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c92457160>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:07.219816 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b5baf69d-0938-439e-b297-151ef3c8acb5 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 200 len: 353 microversion: 2.1 time: 0.058808 Nov 02 04:11:07.220651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1367/2729] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:11:07 2022] GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:11:07.240850 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-21e22190-6493-4b82-b40e-a8007113ce7c tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c924f7dc0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:07.325026 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-21e22190-6493-4b82-b40e-a8007113ce7c tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 202 len: 0 microversion: 2.1 time: 0.088124 Nov 02 04:11:07.325622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1363/2730] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 04:11:07 2022] DELETE /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 04:11:07.338713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7e20d2ee-9caf-4425-b09c-566540fbb92f tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c930c1430>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:07.407300 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7e20d2ee-9caf-4425-b09c-566540fbb92f tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 200 len: 352 microversion: 2.1 time: 0.076916 Nov 02 04:11:07.408168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1368/2731] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:11:07 2022] GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:11:08.225135 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:08.225635 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:08.232193 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:08.232675 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:08.233114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:08.233811 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:08.234267 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:08.234899 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:08.319256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.objects.instance [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lazy-loading 'services' on Instance uuid 40510c62-0278-4f8e-b586-6ebae5ce9915 {{(pid=125410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:11:08.391600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b94ca085-e2b0-4e7b-9636-242d20893ece tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments/c65b3675-1525-41be-be24-04a01d6c5200" status: 202 len: 0 microversion: 2.1 time: 0.171270 Nov 02 04:11:08.392221 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1364/2732] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 04:11:08 2022] DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments/c65b3675-1525-41be-be24-04a01d6c5200 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:11:08.401779 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:08.404162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:08.411419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:08.412765 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:08.413683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:08.414422 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:08.414904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:08.415365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:08.424309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1e28a1ec-a1e4-49a4-8566-5fe06ecaa4a3 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Calling method '.version_select at 0x7f5c924f7f70>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:08.448332 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-e4028415-ed22-43a0-a276-69b19d7d52d6 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051610 Nov 02 04:11:08.449461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1369/2733] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 04:11:08 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:11:08.462822 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-1e28a1ec-a1e4-49a4-8566-5fe06ecaa4a3 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] HTTP exception thrown: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1e28a1ec-a1e4-49a4-8566-5fe06ecaa4a3 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Request method failure captured: Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 HTTP/1.1 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe3ZxgMlsNmeDrlXUGghDEkVRHHD9S_uySG18L9xKKvlty3HGVi22v9JcIAKb7j_ZZBczmNfgRVA_chMwuH88bMN7bxzKlmu6Ua96mpVT3EfxJT7zBPUu8hhHVQVpH8Ab1KXHo053SsHYS10SbzbxrukZgVW1l55-BlbrTqjowg_I-0 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: cb05a034bfbd4df2ba29ede9d20f3ab0 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesGetTestJSON-672675143 Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:11:08.464945 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cb05a034bfbd4df2ba29ede9d20f3ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cb05a034bfbd4df2ba29ede9d20f3ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb05a034bfbd4df2ba29ede9d20f3ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb05a034bfbd4df2ba29ede9d20f3ab0"}]}] Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesGetTestJSON-672675143 Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: cb05a034bfbd4df2ba29ede9d20f3ab0 Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesGetTestJSON-672675143 Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesGetTestJSON-672675143-project Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 44eff86e53bd480485bb1cd37d3db96f Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesGetTestJSON-672675143-project Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '1df19462-5f0f-4c77-ad58-ad719f6c00b8'} Nov 02 04:11:08.466353 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. (HTTP 404) (Request-ID: req-83e31621-e6a0-4afb-835e-36e7b1f30e9e) Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:08.467253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 04:11:08.468391 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 04:11:08.469377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1e28a1ec-a1e4-49a4-8566-5fe06ecaa4a3 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] Returning 404 to user: Volume 1df19462-5f0f-4c77-ad58-ad719f6c00b8 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1e28a1ec-a1e4-49a4-8566-5fe06ecaa4a3 tempest-VolumesGetTestJSON-672675143 tempest-VolumesGetTestJSON-672675143-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8" status: 404 len: 109 microversion: 2.1 time: 0.048461 Nov 02 04:11:08.470647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1365/2734] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:11:08 2022] GET /compute/v2.1/os-volumes/1df19462-5f0f-4c77-ad58-ad719f6c00b8 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 04:11:09.063592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:11:09.073964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:09.074441 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:09.074886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:09.097953 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] Creating event network-changed:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:11:09.103374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-cea312f3-90ec-4285-8799-bfa1aa68d647 req-e11672ab-67b3-44aa-8186-c4e6697b02b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043621 Nov 02 04:11:09.104434 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1370/2735] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:11:09.464341 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:09.467826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:09.475313 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:09.476090 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:09.476725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:09.477605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:09.478154 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:09.478766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:09.511548 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-3398119b-35a6-4ad9-b1fd-790e4713e895 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053820 Nov 02 04:11:09.512389 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1366/2736] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Nov 2 04:11:09 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 04:11:09.526893 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:09.527660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:09.536444 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:09.537854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:09.538948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:09.539672 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:09.540259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:09.541360 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:09.629676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] HTTP exception thrown: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 is not attached to volume c65b3675-1525-41be-be24-04a01d6c5200 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Request method failure captured: Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments/c65b3675-1525-41be-be24-04a01d6c5200 HTTP/1.1 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe1lvYwB7SnQykc7EfKmeO_ZR_MSYzAfvsrFnRhQOL2cf_xiSLqYZe7TP7N7x6mZxG6cgRs2Wm9UgXztANmMxmSrtwFMQeYgzbPuHcVjnIQ_nCf7Kr4j8Qt34R-0tCzNh2DSM2JYWmW8sr7jA1Q6LDYOUALpB37nMxc9JfaNEUBFB3k Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 561a9720212b46e2bb93367218e0f112 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:11:09.632291 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/561a9720212b46e2bb93367218e0f112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_561a9720212b46e2bb93367218e0f112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/561a9720212b46e2bb93367218e0f112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/561a9720212b46e2bb93367218e0f112"}]}] Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 561a9720212b46e2bb93367218e0f112 Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-TestMinimumBasicScenario-353883029-project Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 8b56999a02524408b74371e6f8d158cf Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-TestMinimumBasicScenario-353883029-project Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:11:09.633689 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 is not attached to volume c65b3675-1525-41be-be24-04a01d6c5200 Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'server_id': '40510c62-0278-4f8e-b586-6ebae5ce9915', 'id': 'c65b3675-1525-41be-be24-04a01d6c5200'} Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c65b3675-1525-41be-be24-04a01d6c5200. Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:11:09.634468 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 is not attached to volume c65b3675-1525-41be-be24-04a01d6c5200 Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 is not attached to volume c65b3675-1525-41be-be24-04a01d6c5200 Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:09.635729 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Returning 404 to user: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 is not attached to volume c65b3675-1525-41be-be24-04a01d6c5200 {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:11:09.636740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-09f651c8-2873-4f52-9ff0-97ae28b956fa tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments/c65b3675-1525-41be-be24-04a01d6c5200" status: 404 len: 154 microversion: 2.1 time: 0.114075 Nov 02 04:11:09.636740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1371/2737] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Nov 2 04:11:09 2022] DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915/os-volume_attachments/c65b3675-1525-41be-be24-04a01d6c5200 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:11:10.791858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:10.795151 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:10.801738 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:10.802253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:10.803192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:10.803877 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:10.804394 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:10.804779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:10.829622 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:11:10.903544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-77397dff-f866-4bd9-bc94-b59e65065848 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 204 len: 0 microversion: 2.1 time: 0.115234 Nov 02 04:11:10.904139 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1367/2738] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:11:10 2022] DELETE /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:11:10.914166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:10.914781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:10.923475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:10.923987 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:10.924469 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:10.925153 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:10.925766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:10.926186 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:11.071142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:11:11.079206 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-92237763-ecc4-49a7-81a0-8b8725ea544c tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1556 microversion: 2.1 time: 0.170850 Nov 02 04:11:11.079767 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1372/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:11:10 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:11:12.102180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:12.102968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:12.109444 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:12.109923 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:12.110362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:12.111050 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:12.111499 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:12.111924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:12.247023 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:11:12.255454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1f0555bb-8690-4711-8049-0bcbc3758e8f tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1556 microversion: 2.1 time: 0.157474 Nov 02 04:11:12.256934 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1368/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:11:12 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:11:13.280147 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:13.280841 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:13.287758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:13.288362 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:13.288868 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:13.289658 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:13.290199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:13.290681 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:13.430108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b56999a02524408b74371e6f8d158cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a9720212b46e2bb93367218e0f112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:11:13.458041 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48c9ed2e-b818-40bf-828f-7c955aaf6211 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 200 len: 1556 microversion: 2.1 time: 0.181900 Nov 02 04:11:13.458657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1373/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:11:13 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:11:13.530826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40510c62-0278-4f8e-b586-6ebae5ce9915", "name": "network-vif-deleted", "tag": "e4f6cb9a-1cd8-496a-a694-fe91d3211483"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:11:13.542118 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:13.542821 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:13.543396 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:13.556756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] Creating event network-vif-deleted:e4f6cb9a-1cd8-496a-a694-fe91d3211483 for instance 40510c62-0278-4f8e-b586-6ebae5ce9915 on hv-cinder-86020 Nov 02 04:11:13.562096 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-fc0eebcf-7ba7-4ffc-8067-4014451b683f req-4ac9388b-f034-4a20-b5a5-96c1234ce365 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Nov 02 04:11:13.563270 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1369/2742] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:11:14.482837 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:14.483458 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] [instance: 40510c62-0278-4f8e-b586-6ebae5ce9915] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:11:14.489863 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:14.490340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:14.490776 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:14.491461 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:11:14.491917 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:11:14.492439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:11:14.506484 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] HTTP exception thrown: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Request method failure captured: Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 HTTP/1.1 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe1lvYwB7SnQykc7EfKmeO_ZR_MSYzAfvsrFnRhQOL2cf_xiSLqYZe7TP7N7x6mZxG6cgRs2Wm9UgXztANmMxmSrtwFMQeYgzbPuHcVjnIQ_nCf7Kr4j8Qt34R-0tCzNh2DSM2JYWmW8sr7jA1Q6LDYOUALpB37nMxc9JfaNEUBFB3k Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 561a9720212b46e2bb93367218e0f112 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:11:14.508013 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/561a9720212b46e2bb93367218e0f112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_561a9720212b46e2bb93367218e0f112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/561a9720212b46e2bb93367218e0f112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/561a9720212b46e2bb93367218e0f112"}]}] Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 561a9720212b46e2bb93367218e0f112 Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-TestMinimumBasicScenario-353883029 Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-TestMinimumBasicScenario-353883029-project Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 8b56999a02524408b74371e6f8d158cf Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-TestMinimumBasicScenario-353883029-project Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. Nov 02 04:11:14.509346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '40510c62-0278-4f8e-b586-6ebae5ce9915'} Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:11:14.510131 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. Nov 02 04:11:14.511378 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:11:14.512542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Returning 404 to user: Instance 40510c62-0278-4f8e-b586-6ebae5ce9915 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:11:14.512542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6e2f3c95-fefa-4608-be38-d00357dc7e85 tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915" status: 404 len: 111 microversion: 2.1 time: 0.030473 Nov 02 04:11:14.512542 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1374/2743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:11:14 2022] GET /compute/v2.1/servers/40510c62-0278-4f8e-b586-6ebae5ce9915 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:11:14.518607 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d83dffd-aab0-4138-84d3-514c495484ec tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] Calling method '.version_select at 0x7f5c923a7f70>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:11:14.543005 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d83dffd-aab0-4138-84d3-514c495484ec tempest-TestMinimumBasicScenario-353883029 tempest-TestMinimumBasicScenario-353883029-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1727781910" status: 202 len: 0 microversion: 2.1 time: 0.028440 Nov 02 04:11:14.543746 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1370/2744] 10.222.0.26 () {58 vars in 1272 bytes} [Wed Nov 2 04:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1727781910 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 04:12:02.512948 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:02.513509 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:02.513881 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:02.513965 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:02.517142 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=16 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:02.518931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:12:02.519839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=32 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:02.531342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:02.531732 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:02.532239 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:02.533057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:02.536821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:02.537467 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:02.538307 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:02.539024 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:02.541264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:02.553591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] Creating event network-changed:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:12:02.560132 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-2510ef46-a657-4ccc-8876-94958cf03329 req-3667140f-33a9-4e26-a9c8-8199dea06f28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048590 Nov 02 04:12:02.561350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1371/2745] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:12:02.582203 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Going to try to terminate instance {{(pid=125411) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:12:02.683976 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fdb86959-f1f8-4790-9b36-cd2284961b3a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 204 len: 0 microversion: 2.1 time: 0.174215 Nov 02 04:12:02.685014 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1375/2746] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:12:02 2022] DELETE /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:12:02.696926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:02.697857 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:02.704801 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:02.705595 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:02.706232 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:02.707114 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:02.707779 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:02.708461 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:02.862197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:02.870610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-568f92fe-0e3e-40a9-b1dc-dd27b016edcb tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.180928 Nov 02 04:12:02.871453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1372/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:02 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:12:03.894518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:03.895249 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:03.901578 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:03.902057 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:03.902489 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:03.903173 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:03.903621 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:03.904102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:04.042455 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:04.051712 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-4d07dcbf-86da-449b-854d-df8b91975e1a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1568 microversion: 2.1 time: 0.161436 Nov 02 04:12:04.052396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1376/2748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:03 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:05.077068 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:05.078662 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:05.087214 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:05.088186 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:05.089106 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:05.090009 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:05.090733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:05.091244 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:05.367930 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77", "name": "network-vif-deleted", "tag": "ae0a7c46-ad91-47d7-8b19-94357f3d4d00"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:12:05.370920 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:05.380227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:05.380849 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2f2cdb63-dcef-4e0c-baab-1dfa207eff5a tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1449 microversion: 2.1 time: 0.308515 Nov 02 04:12:05.381218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:05.381649 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:05.381777 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1373/2749] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:05 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1449 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:05.393821 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] Creating event network-vif-deleted:ae0a7c46-ad91-47d7-8b19-94357f3d4d00 for instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 on hv-cinder-86020 Nov 02 04:12:05.398741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-3e305e56-6ff5-4461-a6de-7a8213f1c1e4 req-3d468e78-f954-4b11-a3f9-7d58ac10983c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035706 Nov 02 04:12:05.399888 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1377/2750] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:12:06.408537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:06.409123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:06.416059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:06.416535 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:06.416968 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:06.417644 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:06.418092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:06.418510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:06.481538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:06.489236 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7923a1d1-f44d-4d30-97ad-bc7bb33a1368 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1219 microversion: 2.1 time: 0.084604 Nov 02 04:12:06.489798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1374/2751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:06 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:07.513555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:07.514251 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:07.520568 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:07.521045 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:07.521476 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:07.522161 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:07.522611 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:07.523032 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:07.584038 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:07.591559 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5ac378d1-a11d-42b7-873f-dd3332e0f695 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1219 microversion: 2.1 time: 0.083382 Nov 02 04:12:07.592141 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1378/2752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:07 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:08.613473 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:08.614080 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:08.621117 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:08.621588 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:08.622014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:08.622944 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:08.623386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:08.623802 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:08.687258 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f89c4e2fa8c495fa8bc7f64a3635fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e61d1b98c0b474a95a99962af8b20b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:08.695095 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ad4bbf24-c282-49f7-af58-8301e67ebc9f tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 200 len: 1219 microversion: 2.1 time: 0.085478 Nov 02 04:12:08.695761 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1375/2753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:08 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:09.718389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:09.719000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] [instance: f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:09.725296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:09.725770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:09.726200 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:09.726932 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:09.727381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:09.727798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:09.743606 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] HTTP exception thrown: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Request method failure captured: Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 HTTP/1.1 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYezzr8tUUiIp7ba_k6JEy8-CsmByS5RhZMKzAbxcz5dQMc3-5JqMiw46t15Ds3fo158sV52BJSx-Lm8EW_FT2mOpYTqJxySwaFpiozvFiYqAVtull9fCvGLHHlNBu_FIsNlDtU5vDHA7TuXNCe84K2S03BUOcSnt_EDESpBG0i28Sc4 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 3e61d1b98c0b474a95a99962af8b20b5 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-TestShelveInstance-1787618414 Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:12:09.745226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e61d1b98c0b474a95a99962af8b20b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e61d1b98c0b474a95a99962af8b20b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e61d1b98c0b474a95a99962af8b20b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e61d1b98c0b474a95a99962af8b20b5"}]}] Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-TestShelveInstance-1787618414 Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 3e61d1b98c0b474a95a99962af8b20b5 Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-TestShelveInstance-1787618414 Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-TestShelveInstance-1787618414-project Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7f89c4e2fa8c495fa8bc7f64a3635fe0 Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-TestShelveInstance-1787618414-project Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. Nov 02 04:12:09.746657 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77'} Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:12:09.747543 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. Nov 02 04:12:09.749179 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:12:09.750429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Returning 404 to user: Instance f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:12:09.750429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-bfab4f52-3645-45ff-a7d1-84c3dc9657be tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77" status: 404 len: 111 microversion: 2.1 time: 0.032005 Nov 02 04:12:09.750429 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1379/2754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:09 2022] GET /compute/v2.1/servers/f1ae3d9d-7dcb-4a9d-aaf8-e54bff4fcc77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:12:09.907400 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ac5899f8-3672-43cb-b20c-d95c7c005914 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] Calling method '.version_select at 0x7f5c92402c10>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:09.928953 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ac5899f8-3672-43cb-b20c-d95c7c005914 tempest-TestShelveInstance-1787618414 tempest-TestShelveInstance-1787618414-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459270510" status: 202 len: 0 microversion: 2.1 time: 0.024991 Nov 02 04:12:09.931061 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1376/2755] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Nov 2 04:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459270510 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 04:12:33.539443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:33.540135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:33.737022 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Action: 'create', calling method: .version_select at 0x7f5c92356a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-122927319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2azIYoSLMMV94m8v/eF5/zYUJdhpohsqPlgPQVRY0sSnH+mH5RBm8SO/Dm0BTQfmBaGpbEbidtfC8uPGKoxLHpt8wKJcKB1ElgNlpXB3mqbOyXfaXjU/k0/+DzpOlqWw=="}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:12:33.754224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:12:33.758833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for user 390f0d31f2ee42d9aba3922cce6e78ee and project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'key_pairs'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:12:33.771654 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [00be4454-acd3-4769-91e5-511b8dd3c352] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 04:12:34.778241 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [00be4454-acd3-4769-91e5-511b8dd3c352] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 46068. Nov 02 04:12:34.793176 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6d9ccbc9-ec5c-475e-9eb5-52ad3f0d3133 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.260819 Nov 02 04:12:34.793770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1380/2756] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Nov 2 04:12:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:12:53.239116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-468492630", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122927319", "security_groups": [{"name": "tempest-secgroup-smoke-1593082942"}], "block_device_mapping_v2": [{"uuid": "827378a3-915d-4125-86da-d16ee6c51fb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e27cb649-4a3b-4b17-a38e-4fe34cbd56b8"}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:12:53.250511 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=26 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:53.251145 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:53.252160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:12:53.252296 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Nov 02 04:12:53.473265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] validate_networks() for [('e27cb649-4a3b-4b17-a38e-4fe34cbd56b8', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:12:53.921879 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:12:53.922307 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:12:53.922783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:12:53.923192 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:12:53.923605 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:12:53.932428 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:53.932908 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:53.933344 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:53.934092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:53.934526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:53.934950 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:53.952241 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:12:53.956259 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for user 390f0d31f2ee42d9aba3922cce6e78ee and project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:12:54.012540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:12:54.014608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='827378a3-915d-4125-86da-d16ee6c51fb3',volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:12:54.143625 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c55f3eb5-e71c-474a-9ca4-84ea83a6bfd2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.908434 Nov 02 04:12:54.150941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1377/2757] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:12:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:12:54.153277 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=4 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:54.154027 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:12:54.158641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d71a151d-4acb-424f-aef9-dab795e344f8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:54.159260 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d71a151d-4acb-424f-aef9-dab795e344f8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:54.218886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d71a151d-4acb-424f-aef9-dab795e344f8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:54.225605 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d71a151d-4acb-424f-aef9-dab795e344f8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1093 microversion: 2.1 time: 0.073604 Nov 02 04:12:54.226163 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1381/2758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:54 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:12:55.249235 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:55.249815 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:55.256302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:55.256772 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:55.257200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:55.257885 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:55.258318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:55.258741 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:55.318965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:55.327071 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-a6c1e7cd-6cb0-4330-92c9-73e4afad9c05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1191 microversion: 2.1 time: 0.082414 Nov 02 04:12:55.327653 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1378/2759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:55 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:56.350572 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:56.351146 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:56.358339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:56.358830 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:56.359269 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:56.359992 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:56.360717 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:56.361214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:56.554529 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:56.563037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5816fd65-87fb-4b4c-902a-27cec25410ca tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.216404 Nov 02 04:12:56.563609 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1382/2760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:56 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:12:56.859708 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd6662c-4740-4d9d-9d77-76973e7ffac4", "tag": "c0858eae-f442-42cb-8ce5-66fdb705dc33"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:12:56.869666 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:56.870481 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:56.870594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:56.882041 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] Creating event network-changed:c0858eae-f442-42cb-8ce5-66fdb705dc33 for instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 on hv-cinder-86020 Nov 02 04:12:56.886762 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-9db969a1-5a6e-4d09-bdea-c847859e2145 req-e4f862aa-9394-44f8-af63-ed78996274b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030703 Nov 02 04:12:56.887347 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1379/2761] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:12:57.586076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:57.586676 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:57.592981 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:57.593471 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:57.593910 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:57.594604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:57.595069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:57.595656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:57.731581 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:57.739196 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-ff20e412-6f08-49b2-b677-667383a8bdde tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.157341 Nov 02 04:12:57.739764 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1383/2762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:57 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:12:58.763269 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:58.763979 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:58.770019 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:58.770495 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:58.770926 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:58.771603 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:58.772082 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:58.772507 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:58.906172 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:12:58.913969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c89eba0a-290e-41a9-930a-9921c0724aef tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.155736 Nov 02 04:12:58.914422 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1380/2763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:58 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:12:59.936304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:12:59.936915 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:12:59.943228 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:59.943700 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:59.944168 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:12:59.944844 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:12:59.945288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:12:59.945706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:00.071735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:00.079848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0019fa0e-a584-42e4-8ff5-30ec16d7f2ba tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.147374 Nov 02 04:13:00.080425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1384/2764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:12:59 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:01.103011 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:01.104302 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:01.110674 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:01.111152 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:01.111587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:01.112293 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:01.112745 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:01.113168 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:01.245873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:01.253722 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1d769e8b-e46e-4e3b-a848-645776915553 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.154576 Nov 02 04:13:01.254277 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1381/2765] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:01 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:02.276597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:02.277211 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:02.284340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:02.284811 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:02.285238 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:02.285919 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:02.286365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:02.286782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:02.418275 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:02.425870 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-315be67b-ac50-41be-9d07-992c79d758a2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.153081 Nov 02 04:13:02.426439 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1385/2766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:02 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:03.449766 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:03.450386 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:03.456938 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:03.457415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:03.457847 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:03.458523 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:03.458967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:03.459384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:03.587155 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:03.594810 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b89ecd6c-43fd-4ca2-89e8-373237f48f11 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.149520 Nov 02 04:13:03.595369 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1382/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:03 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:04.617719 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:04.618340 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:04.622432 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:13:04.626604 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:04.627102 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:04.627547 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:04.628294 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:04.628727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:04.629185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:04.764854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:04.772387 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f60da2fc-df23-4f14-b6d3-0db1fd4dd3be tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.158501 Nov 02 04:13:04.772955 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1386/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:04 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:05.795852 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:05.796486 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:05.798395 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:13:05.799044 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:13:05.805478 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:05.805952 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:05.806387 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:05.807058 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:05.807501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:05.807921 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:05.934425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:05.943453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-97a83d3b-397e-4206-8c63-2ca8e0ca5a56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.151383 Nov 02 04:13:05.944033 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1383/2769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:05 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:06.096805 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd6662c-4740-4d9d-9d77-76973e7ffac4", "name": "network-vif-plugged", "status": "completed", "tag": "c0858eae-f442-42cb-8ce5-66fdb705dc33"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:13:06.107049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:06.107534 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:06.108127 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:06.119136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] Creating event network-vif-plugged:c0858eae-f442-42cb-8ce5-66fdb705dc33 for instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 on hv-cinder-86020 Nov 02 04:13:06.124370 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-2982790f-1f20-40fb-a78b-4c6337d7ae63 req-fb6944ea-486d-458e-95ff-1b93f004eb09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 Nov 02 04:13:06.125148 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1387/2770] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:13:06.966370 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:06.967002 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:06.973494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:06.973966 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:06.974399 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:06.975074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:06.975520 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:06.975936 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:07.102566 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:07.110771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-acb6860a-577c-4fed-afd9-65df8e1e0455 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1265 microversion: 2.1 time: 0.148174 Nov 02 04:13:07.111327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1384/2771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:06 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:08.135170 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:08.135833 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:08.141970 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:08.142447 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:08.142985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:08.143615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:08.144091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:08.144518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:08.273714 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:08.281738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0bc7c7e7-ccc4-4213-9ffc-640516489e8d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1452 microversion: 2.1 time: 0.151975 Nov 02 04:13:08.282296 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1388/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:08 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:08.304283 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:08.304874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:08.312040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:08.312513 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:08.312943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:08.313612 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:08.314055 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:08.314469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:08.444014 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:13:08.451756 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6c3c4de9-3ddd-45f5-b3d0-b68d3e7cd57d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1452 microversion: 2.1 time: 0.151233 Nov 02 04:13:08.452342 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1385/2773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:08 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:13:10.327069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd6662c-4740-4d9d-9d77-76973e7ffac4", "tag": "c0858eae-f442-42cb-8ce5-66fdb705dc33"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:13:10.336892 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:10.337946 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:10.338466 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:10.349615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] Creating event network-changed:c0858eae-f442-42cb-8ce5-66fdb705dc33 for instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 on hv-cinder-86020 Nov 02 04:13:10.355453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-1206a602-aa23-4f23-ae70-53fbfe411947 req-eda7a0b2-fb1f-4c8b-b15e-847b00c3cb99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032077 Nov 02 04:13:10.356062 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1389/2774] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:13:17.399586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:17.400123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:17.406771 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:17.407243 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:17.407673 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:17.408372 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:17.408819 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:17.409233 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:17.422659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa HTTP/1.1 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:13:17.424314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.425748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '9436aec2-8b2e-443f-a1c7-21a459f4bafa'} Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:17.426526 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.427628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.428826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:17.428826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-5a366335-defc-478e-8407-af90387050ae tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 404 len: 111 microversion: 2.1 time: 0.029920 Nov 02 04:13:17.428826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1386/2775] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:13:17 2022] DELETE /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:13:17.435683 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:17.436412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] [instance: 9436aec2-8b2e-443f-a1c7-21a459f4bafa] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:13:17.442586 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:17.443063 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:17.443503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:17.444214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:13:17.444667 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:13:17.445091 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:13:17.458443 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] HTTP exception thrown: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Request method failure captured: Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa HTTP/1.1 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYeUUSPWzX8nw_kilSgLt4mCVG5_88OEcAK8_oDKSmYY6b5SaxceM5TuGTQx_XE9DUoMjgdvBFX-t4H_yoBjTxFsbZ0d8dCXY3n3W8uQ4BS1eSIPd2Jpqfsmsntb-fxfQ22IFWSZZzZ7G8VCLJELTO9jE_ocPBzhdEitr05BHIvaZSxI Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:13:17.460067 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10a674b48d484716a8a79d518ea0d579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10a674b48d484716a8a79d518ea0d579"}]}] Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 10a674b48d484716a8a79d518ea0d579 Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-571549851 Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 7984dc1d452a4c998b44e6d26a299df8 Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-AttachVolumeNegativeTest-571549851-project Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.461481 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '9436aec2-8b2e-443f-a1c7-21a459f4bafa'} Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:17.462377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. Nov 02 04:13:17.463687 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:17.464975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] Returning 404 to user: Instance 9436aec2-8b2e-443f-a1c7-21a459f4bafa could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:17.464975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-69651fee-b898-4b23-a862-8d071a6b5f57 tempest-AttachVolumeNegativeTest-571549851 tempest-AttachVolumeNegativeTest-571549851-project] 10.222.0.26 "GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa" status: 404 len: 111 microversion: 2.1 time: 0.031173 Nov 02 04:13:17.464975 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1390/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:13:17 2022] GET /compute/v2.1/servers/9436aec2-8b2e-443f-a1c7-21a459f4bafa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:13:21.800871 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6bbb79d8-3b0f-4026-b3e2-19884fc31f38 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Action: 'create', calling method: .version_select at 0x7f5c9271a940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1675787351", "metadata": {"Type": "work"}}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6bbb79d8-3b0f-4026-b3e2-19884fc31f38 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 122 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:13:21.810065 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1675787351", "metadata": {"Type": "work"}}} Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 04:13:21.811512 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1675787351', 'metadata': {'Type': 'work'}}}} Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise error Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.812459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 04:13:21.813992 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 04:13:21.815350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 04:13:21.815350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.815350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-6bbb79d8-3b0f-4026-b3e2-19884fc31f38 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.815350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-6bbb79d8-3b0f-4026-b3e2-19884fc31f38 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122552 Nov 02 04:13:21.815350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1387/2777] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 04:13:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 04:13:21.821801 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9989cfa-c33a-4f4c-a2b9-222b297b9861 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Action: 'create', calling method: .version_select at 0x7f5c95c67b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-409716485", "metadata": {"Type": "work"}}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9989cfa-c33a-4f4c-a2b9-222b297b9861 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 119 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:13:21.826900 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-409716485", "metadata": {"Type": "work"}}} Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: Nov 02 04:13:21.828319 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-409716485', 'metadata': {'Type': 'work'}}}} Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise error Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi '0' Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.829167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 04:13:21.830576 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 04:13:21.831639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 04:13:21.831639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.831639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d9989cfa-c33a-4f4c-a2b9-222b297b9861 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.831639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d9989cfa-c33a-4f4c-a2b9-222b297b9861 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010256 Nov 02 04:13:21.831639 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1391/2778] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 04:13:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 04:13:21.837993 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d5b22cdf-1689-4958-a268-09c875cb2bb5 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Action: 'create', calling method: .version_select at 0x7f5c9246b280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953890003", "metadata": {"Type": "work"}}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d5b22cdf-1689-4958-a268-09c875cb2bb5 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 118 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:13:21.842057 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953890003", "metadata": {"Type": "work"}}} Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 04:13:21.843409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-953890003', 'metadata': {'Type': 'work'}}}} Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise error Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi '' Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.844310 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 04:13:21.845706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 04:13:21.846924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 04:13:21.846924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.846924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d5b22cdf-1689-4958-a268-09c875cb2bb5 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.846924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d5b22cdf-1689-4958-a268-09c875cb2bb5 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009922 Nov 02 04:13:21.846924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1388/2779] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Nov 2 04:13:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 04:13:21.852832 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3423a1d9-0434-4141-a70a-6a2d16abc205 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Calling method '.version_select at 0x7f5c930c1a60>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:21.881462 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-3423a1d9-0434-4141-a70a-6a2d16abc205 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] HTTP exception thrown: Volume tempest-invalid-1854048466 could not be found. Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3423a1d9-0434-4141-a70a-6a2d16abc205 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1854048466 HTTP/1.1 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:13:21.883366 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Volume tempest-invalid-1854048466 could not be found. Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': 'tempest-invalid-1854048466'} Nov 02 04:13:21.884738 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1854048466 could not be found. (HTTP 404) (Request-ID: req-b1171ffd-debb-4972-9a21-2bc4da6f7c7f) Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.886908 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 04:13:21.888555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1854048466 could not be found. Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:13:21.890587 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1854048466 could not be found. Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1854048466 could not be found. Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-3423a1d9-0434-4141-a70a-6a2d16abc205 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 404 to user: Volume tempest-invalid-1854048466 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-3423a1d9-0434-4141-a70a-6a2d16abc205 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1854048466" status: 404 len: 99 microversion: 2.1 time: 0.036018 Nov 02 04:13:21.891911 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1392/2780] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Nov 2 04:13:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1854048466 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 04:13:21.894782 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-828c499e-5052-4d03-ad22-7c8dcf00eb85 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003718 Nov 02 04:13:21.895261 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1389/2781] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Nov 2 04:13:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 04:13:21.903869 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-f167f0a5-a95a-4ac4-8650-128dd0027aaf tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004250 Nov 02 04:13:21.904396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1393/2782] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Nov 2 04:13:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 04:13:21.912020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b391dcf-3cea-462c-bfc3-1c6f21330222 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Calling method '.version_select at 0x7f5c923623a0>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:21.939245 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-1b391dcf-3cea-462c-bfc3-1c6f21330222 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] HTTP exception thrown: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b391dcf-3cea-462c-bfc3-1c6f21330222 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: DELETE /compute/v2.1/os-volumes/d42412da-8e0b-48a7-91a9-8940496cc5ea HTTP/1.1 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:13:21.941182 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': 'd42412da-8e0b-48a7-91a9-8940496cc5ea'} Nov 02 04:13:21.942623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. (HTTP 404) (Request-ID: req-4aa8b8d0-5737-40bb-a6bc-92ae2347bbf5) Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.943594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 04:13:21.945007 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 04:13:21.946250 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-1b391dcf-3cea-462c-bfc3-1c6f21330222 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 404 to user: Volume d42412da-8e0b-48a7-91a9-8940496cc5ea could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-1b391dcf-3cea-462c-bfc3-1c6f21330222 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/d42412da-8e0b-48a7-91a9-8940496cc5ea" status: 404 len: 109 microversion: 2.1 time: 0.033930 Nov 02 04:13:21.947568 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1390/2783] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Nov 2 04:13:21 2022] DELETE /compute/v2.1/os-volumes/d42412da-8e0b-48a7-91a9-8940496cc5ea => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:13:21.954140 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8bbc16bb-e4bd-4e8b-9b3d-8c52f693a607 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Calling method '.version_select at 0x7f5c925dc280>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:13:21.981166 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-8bbc16bb-e4bd-4e8b-9b3d-8c52f693a607 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] HTTP exception thrown: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8bbc16bb-e4bd-4e8b-9b3d-8c52f693a607 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Request method failure captured: Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/os-volumes/8e893b6f-4e3e-435f-9268-95d1c2ea2a58 HTTP/1.1 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe5huPE1upYnkZYkHjl5hKAkrze1NuLgUVYIsFMN6QtC5FSYuNohl5G4duM-Zuvdmm4-bfNx3JDy3nJpfd9DImNt9c-HR9e3uaycyzbxFMOEaQNkJ5dyQ51i_npj7o2gQx5fOPCmHTLAYLKxBaEQH1jXc0zzwXxibet3Qek3DhR8Sq4 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:13:21.983070 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/338cf5433fef44f1a76d460cad6b08f1"}]}] Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 338cf5433fef44f1a76d460cad6b08f1 Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-VolumesNegativeTest-1466186396 Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: f518e01f9f8d4a18947fe4cc91e47325 Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-VolumesNegativeTest-1466186396-project Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '8e893b6f-4e3e-435f-9268-95d1c2ea2a58'} Nov 02 04:13:21.984567 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. (HTTP 404) (Request-ID: req-66097ed6-69f0-4e66-bb3a-ad400ff18c95) Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.985377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 04:13:21.986513 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 04:13:21.987651 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8bbc16bb-e4bd-4e8b-9b3d-8c52f693a607 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] Returning 404 to user: Volume 8e893b6f-4e3e-435f-9268-95d1c2ea2a58 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8bbc16bb-e4bd-4e8b-9b3d-8c52f693a607 tempest-VolumesNegativeTest-1466186396 tempest-VolumesNegativeTest-1466186396-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e893b6f-4e3e-435f-9268-95d1c2ea2a58" status: 404 len: 109 microversion: 2.1 time: 0.034235 Nov 02 04:13:21.988781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1394/2784] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Nov 2 04:13:21 2022] GET /compute/v2.1/os-volumes/8e893b6f-4e3e-435f-9268-95d1c2ea2a58 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:15:12.339197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bfcb1895-9984-405c-88ad-838e75f41a05] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 04:15:12.339759 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:12.340325 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=48 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:12.341441 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:15:12.341624 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 (ip 10.222.0.26) !!! Nov 02 04:15:12.347896 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:12.348426 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:12.356733 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:12.357213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:12.357649 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:12.358331 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:12.358785 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:12.359207 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:12.385964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:15:12.458265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-cc2fc16c-e8de-4d5c-b1d4-ce85866dcf92 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 204 len: 0 microversion: 2.1 time: 0.123351 Nov 02 04:15:12.458832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1391/2785] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:15:12 2022] DELETE /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:15:12.466065 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR oslo.messaging._drivers.impl_rabbit [-] [673ae10b-47d0-403b-9cb5-d82204daa442] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 04:15:12.467031 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=22 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:12.467770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=42 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:12.469128 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 04:15:12.470391 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:15:12.470511 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 (ip 10.222.0.26) !!! Nov 02 04:15:12.477119 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:12.477760 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:12.485309 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:12.485790 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:12.486226 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:12.486918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:12.488008 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:12.488445 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:12.758427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:12.766029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-b1486d5f-2c1c-4005-9688-d2df51e66d08 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1577 microversion: 2.1 time: 0.302883 Nov 02 04:15:12.766575 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1395/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:12 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1577 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:13.790123 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:13.790804 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:13.798501 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:13.798982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:13.799418 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:13.800638 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:13.801088 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:13.801510 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:13.817357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] [bfcb1895-9984-405c-88ad-838e75f41a05] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47328. Nov 02 04:15:13.934377 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:13.942158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-06234752-21aa-4f30-8423-c5f330116831 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1577 microversion: 2.1 time: 0.156383 Nov 02 04:15:13.942716 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1392/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:13 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:14.965116 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:14.965772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:14.973325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:14.973808 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:14.974259 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:14.974951 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:14.975407 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:14.975831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:14.981964 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] [673ae10b-47d0-403b-9cb5-d82204daa442] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47332. Nov 02 04:15:15.207421 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:15.215172 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-168ce513-1648-4c08-a96a-b153b5f091e4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1577 microversion: 2.1 time: 0.253995 Nov 02 04:15:15.215741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1396/2788] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:14 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:15:15.491136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd6662c-4740-4d9d-9d77-76973e7ffac4", "name": "network-vif-deleted", "tag": "c0858eae-f442-42cb-8ce5-66fdb705dc33"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:15:15.503780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:15.504289 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:15.504730 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:15.526645 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] Creating event network-vif-deleted:c0858eae-f442-42cb-8ce5-66fdb705dc33 for instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 on hv-cinder-86020 Nov 02 04:15:15.533543 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-544d74b5-a679-4bfa-a88c-6c110d9b3eb5 req-9dc96e35-f865-4e7d-9921-c06bb959983d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116527 Nov 02 04:15:15.535412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1393/2789] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:15:16.239002 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:16.239615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:16.246895 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:16.247701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:16.248726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:16.248857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:16.249312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:16.249730 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:16.280979 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:16.281452 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:16.281886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:16.282324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.objects.instance [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lazy-loading 'fault' on Instance uuid 1cd6662c-4740-4d9d-9d77-76973e7ffac4 {{(pid=125411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 04:15:16.325485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:16.333674 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a1913d50-d69f-4b6b-9008-f0098599dc1e tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 200 len: 1229 microversion: 2.1 time: 0.099309 Nov 02 04:15:16.334242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1397/2790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:16 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:17.358198 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:17.358891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:17.365538 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:17.366015 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:17.366446 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:17.367127 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:17.367572 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:17.368016 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:17.381778 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] HTTP exception thrown: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Request method failure captured: Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 HTTP/1.1 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe4sRjoLNIgRQfPQjTsN9elCjbXFp4uOIE2tPbFBCpSBcq6aaqcJPKHai9E-p3i8zh_SMVdnM7R7-LHm-L7Om0EQlb5bxa2W6RUnqwmTYWwawumMQFJJc3NqIPccu2q_Op1Zw1GOET74n8h7MmE48gXSl4kzhq3_Aq2JCH4HqGApCtc Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:15:17.383357 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}] Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 390f0d31f2ee42d9aba3922cce6e78ee Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:15:17.384915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '1cd6662c-4740-4d9d-9d77-76973e7ffac4'} Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:15:17.385982 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:15:17.387459 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:15:17.388774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Returning 404 to user: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:15:17.388774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8729cf02-504c-4d12-b1da-d523785139df tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 404 len: 111 microversion: 2.1 time: 0.031213 Nov 02 04:15:17.388774 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1394/2791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:17 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:15:17.479083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1611621485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122927319", "security_groups": [{"name": "tempest-secgroup-smoke-1593082942"}], "block_device_mapping_v2": [{"uuid": "827378a3-915d-4125-86da-d16ee6c51fb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e27cb649-4a3b-4b17-a38e-4fe34cbd56b8"}]}} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:15:17.591288 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.network.neutron [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] validate_networks() for [('e27cb649-4a3b-4b17-a38e-4fe34cbd56b8', None, None, None, None, None)] {{(pid=125411) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:15:18.001747 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:15:18.002171 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image limits 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:15:18.002641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:15:18.003046 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image pref 0:0:0 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:15:18.003457 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.virt.hardware [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:15:18.012310 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:18.012727 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:18.013159 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:18.013871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:18.014320 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:18.014742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:18.031400 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:15:18.035866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.quota [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for user 390f0d31f2ee42d9aba3922cce6e78ee and project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:15:18.090735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Going to run 1 instances... {{(pid=125411) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:15:18.092933 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='827378a3-915d-4125-86da-d16ee6c51fb3',volume_size=None,volume_type=None)] {{(pid=125411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:15:18.224420 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fcce8a6e-11fc-41da-9c08-05f7c04ec024 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749101 Nov 02 04:15:18.225076 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1398/2792] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:15:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:15:18.236077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-aab0370a-ef85-49ce-bc27-b40d405d4cc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:18.236681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-aab0370a-ef85-49ce-bc27-b40d405d4cc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:18.289402 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-aab0370a-ef85-49ce-bc27-b40d405d4cc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:18.296166 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-aab0370a-ef85-49ce-bc27-b40d405d4cc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1094 microversion: 2.1 time: 0.063957 Nov 02 04:15:18.296714 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1395/2793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:18 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:19.319330 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-aa3667ed-fd91-450d-914f-3d1f1cc2fa50 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:19.319847 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-aa3667ed-fd91-450d-914f-3d1f1cc2fa50 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:19.375413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-aa3667ed-fd91-450d-914f-3d1f1cc2fa50 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:19.382346 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-aa3667ed-fd91-450d-914f-3d1f1cc2fa50 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1094 microversion: 2.1 time: 0.067572 Nov 02 04:15:19.382990 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1399/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:19 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:20.404836 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-ed8f779e-041c-48f8-90fe-87a1dbfe588c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:20.405450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-ed8f779e-041c-48f8-90fe-87a1dbfe588c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:20.459180 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-ed8f779e-041c-48f8-90fe-87a1dbfe588c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:20.466125 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-ed8f779e-041c-48f8-90fe-87a1dbfe588c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1094 microversion: 2.1 time: 0.065145 Nov 02 04:15:20.466679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1396/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:20 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:21.488772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8d9a96b8-4534-4530-bb20-12ea455a6550 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:21.489393 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8d9a96b8-4534-4530-bb20-12ea455a6550 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:21.542626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8d9a96b8-4534-4530-bb20-12ea455a6550 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:21.550124 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8d9a96b8-4534-4530-bb20-12ea455a6550 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1094 microversion: 2.1 time: 0.065344 Nov 02 04:15:21.550671 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1400/2796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:21 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:22.572275 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:22.572891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:22.579382 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:22.579854 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:22.580319 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:22.581533 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:22.581976 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:22.582393 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:22.641719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:22.650020 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-b3309cdf-9d2d-4ae5-b138-e2cb0fdc5ebf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1144 microversion: 2.1 time: 0.081511 Nov 02 04:15:22.650579 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1397/2797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:22 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:23.672887 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:23.673507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:23.679854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:23.680470 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:23.680812 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:23.681503 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:23.681958 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:23.682384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:23.774498 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:23.782096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-d822326e-3fe4-4d3b-9bc7-21487c235172 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1210 microversion: 2.1 time: 0.113020 Nov 02 04:15:23.782656 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1401/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:23 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:24.804610 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:24.805142 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:24.811841 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:24.812388 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:24.812833 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:24.813598 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:24.814054 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:24.814479 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:25.108121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:25.115687 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-08ad032b-836c-4fc4-bc0e-c55bf0d400fc tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.315153 Nov 02 04:15:25.116282 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1398/2799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:24 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:25.229711 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f29aac9-b6d4-428c-a2d5-f3b20482036a", "tag": "a5c55c21-fbbc-47c2-a8dd-79c23a5352bb"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:15:25.240626 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:25.241107 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:25.241545 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:25.253766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] Creating event network-changed:a5c55c21-fbbc-47c2-a8dd-79c23a5352bb for instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a on hv-cinder-86020 Nov 02 04:15:25.258574 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-2634eda6-43c5-4284-abb9-f296b0540b37 req-9899166a-2c63-4b1f-855b-bb4df567e273 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032542 Nov 02 04:15:25.259162 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1402/2800] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:15:26.138591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:26.139256 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:26.146297 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:26.146780 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:26.147218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:26.147904 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:26.148381 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:26.148807 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:26.360109 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:26.368272 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c66f787a-f504-4b67-8a74-2e93611a7f36 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.233504 Nov 02 04:15:26.369040 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1399/2801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:26 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:27.392074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:27.392782 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:27.398967 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:27.399453 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:27.399896 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:27.400610 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:27.401069 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:27.401499 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:27.530312 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:27.538678 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-0f01c13c-e8a7-4d1d-876c-6f590902f715 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.151283 Nov 02 04:15:27.539245 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1403/2802] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:27 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:28.561586 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:28.562199 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:28.569121 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:28.569597 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:28.570029 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:28.570713 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:28.571160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:28.571585 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:28.705412 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:28.712983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7c5bf26d-303c-4e30-90a3-ae30ba44b91b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.155198 Nov 02 04:15:28.713540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1400/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:28 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:29.735350 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:29.735977 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:29.738552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:29.744183 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:29.744661 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:29.745093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:29.745769 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:29.746218 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:29.746637 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:29.873058 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:29.880731 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-c94cb1fc-1180-4bd7-9c04-6852e5d64e3a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.149183 Nov 02 04:15:29.881299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1404/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:29 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:30.902628 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:30.903147 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:30.905551 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=4 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:30.910893 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:30.911366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:30.911796 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:30.912497 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:30.912941 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:30.913361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:31.042684 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:31.050711 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d891c882-4f48-440e-a7f8-533e7e4fbff5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.152012 Nov 02 04:15:31.051260 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1401/2805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:30 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:32.072849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:32.073456 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:32.075701 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=10 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:15:32.081000 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:32.081463 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:32.081891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:32.082588 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:32.083018 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:32.083436 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:32.209324 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:32.216857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-da4f0e71-87fc-4c5c-b906-46745fc81f0d tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.147867 Nov 02 04:15:32.217413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1405/2806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:32 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:33.239591 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:33.240231 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:33.246587 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:33.247304 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:33.247744 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:33.248453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:33.248905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:33.249324 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:33.380417 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:33.388051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f1de3bbf-ed7e-4753-bc63-74088f6519d2 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.152227 Nov 02 04:15:33.388609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1402/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:33 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:34.411132 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:34.411775 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:34.418292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:34.418771 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:34.419201 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:34.419880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:34.420356 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:34.420777 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:34.549549 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:34.557133 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-48a8c714-4fc0-42c9-83b0-050abdf6c92c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.150395 Nov 02 04:15:34.557686 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1406/2808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:34 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:35.579731 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:35.580376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:35.586905 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:35.587384 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:35.587823 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:35.588544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:35.588998 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:35.589423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:35.715413 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:35.723652 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-2c6abbb1-4c30-4551-9689-0708acfe1aaa tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.147779 Nov 02 04:15:35.724265 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1403/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:35 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:36.746849 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:36.747709 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:36.754029 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:36.754507 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:36.754939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:36.755620 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:36.756092 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:36.756514 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:36.865930 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f29aac9-b6d4-428c-a2d5-f3b20482036a", "name": "network-vif-plugged", "status": "completed", "tag": "a5c55c21-fbbc-47c2-a8dd-79c23a5352bb"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:15:36.876018 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:36.876494 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:36.876924 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:36.887851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] Creating event network-vif-plugged:a5c55c21-fbbc-47c2-a8dd-79c23a5352bb for instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a on hv-cinder-86020 Nov 02 04:15:36.893719 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-589cfd2f-2dd1-4fac-9192-0c4e25307e28 req-bcded419-cbcc-4cc2-9d34-933194e76465 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097983 Nov 02 04:15:36.894562 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1404/2810] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:15:36.900389 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:36.908285 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-370a3ea6-c76d-495d-94fc-21f07088dee4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.165262 Nov 02 04:15:36.909474 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1407/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:36 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:37.931989 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:37.932620 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:37.939083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:37.939557 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:37.940213 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:37.941263 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:37.941712 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:37.942131 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:38.072098 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:38.079737 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-8730f54e-0858-4ce1-8bbc-8fa6a752dc67 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1266 microversion: 2.1 time: 0.152116 Nov 02 04:15:38.080318 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1405/2812] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:37 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:39.102758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:39.103396 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:39.109799 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:39.110304 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:39.110740 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:39.111425 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:39.111877 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:39.112329 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:39.240278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:39.248167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-23ea7c93-f683-495e-8a71-fe743623a0ec tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1454 microversion: 2.1 time: 0.149243 Nov 02 04:15:39.248735 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1408/2813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:39 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:39.270729 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:15:39.271334 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:15:39.277965 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:39.278445 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:39.278915 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:39.279630 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:39.280115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:39.280537 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:39.408608 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:15:39.416291 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-d25e289e-5900-41e6-a893-0ccaae66507f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1454 microversion: 2.1 time: 0.149800 Nov 02 04:15:39.416855 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1406/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:15:39 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:15:40.929276 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f29aac9-b6d4-428c-a2d5-f3b20482036a", "tag": "a5c55c21-fbbc-47c2-a8dd-79c23a5352bb"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:15:40.939185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:15:40.939573 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:15:40.940673 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:15:40.951622 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] Creating event network-changed:a5c55c21-fbbc-47c2-a8dd-79c23a5352bb for instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a on hv-cinder-86020 Nov 02 04:15:40.957306 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-8f3fc0d5-47a0-446a-82a0-ac4ed3988eed req-05d5537b-54d5-4f8c-bff7-b3beafa6b1c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Nov 02 04:15:40.957886 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1409/2815] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:17:26.612292 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:26.613074 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:26.614200 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:17:26.614375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Nov 02 04:17:26.618951 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1970812897", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122927319", "security_groups": [{"name": "tempest-secgroup-smoke-1593082942"}], "block_device_mapping_v2": [{"uuid": "7bb06538-471e-431b-81e5-5be26ba8e1e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e27cb649-4a3b-4b17-a38e-4fe34cbd56b8"}]}} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:17:26.731692 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.network.neutron [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] validate_networks() for [('e27cb649-4a3b-4b17-a38e-4fe34cbd56b8', None, None, None, None, None)] {{(pid=125410) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 04:17:27.094449 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 04:17:27.094876 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image limits 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 04:17:27.095340 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Flavor pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 04:17:27.095790 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Image pref 0:0:0 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 04:17:27.096225 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.virt.hardware [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 04:17:27.104866 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:27.105335 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:27.105760 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:27.106470 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:27.106914 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:27.107336 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:27.124435 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 04:17:27.128376 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.quota [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Getting quotas for user 390f0d31f2ee42d9aba3922cce6e78ee and project 143ef6c3d11b42c595e2fda02cc5a1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=125410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 04:17:27.185326 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Going to run 1 instances... {{(pid=125410) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 04:17:27.187409 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bb06538-471e-431b-81e5-5be26ba8e1e0',volume_size=None,volume_type=None)] {{(pid=125410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 04:17:27.316119 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-922a019d-3524-4572-baad-e443585e8e0a tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705548 Nov 02 04:17:27.316758 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1407/2816] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Nov 2 04:17:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 04:17:27.325973 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR oslo.messaging._drivers.impl_rabbit [-] [673ae10b-47d0-403b-9cb5-d82204daa442] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 04:17:27.327136 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:27.327880 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=68 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:27.333085 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-a8e3c7a8-e91a-43dd-8d7e-ebf914470965 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:27.333796 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-a8e3c7a8-e91a-43dd-8d7e-ebf914470965 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:27.392419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-a8e3c7a8-e91a-43dd-8d7e-ebf914470965 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:27.400025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-a8e3c7a8-e91a-43dd-8d7e-ebf914470965 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1094 microversion: 2.1 time: 0.075955 Nov 02 04:17:27.400591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1410/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:27 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:28.423832 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:28.424697 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:28.431858 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:28.432375 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:28.432812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:28.433500 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:28.433949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:28.434371 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:28.526888 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:28.536489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9830fbe3-6c04-48bc-bf06-2f471438d688 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1200 microversion: 2.1 time: 0.115886 Nov 02 04:17:28.536489 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1408/2818] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:28 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:29.558158 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:29.558854 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:29.567156 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:29.567640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:29.568593 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:29.569278 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:29.569726 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:29.570143 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:29.586485 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] [673ae10b-47d0-403b-9cb5-d82204daa442] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47518. Nov 02 04:17:29.790095 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:29.798327 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-94c01b57-21a8-4161-b137-68bce40ce57b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.244101 Nov 02 04:17:29.798904 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1411/2819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:29 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:29.924469 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f85259-f6cf-48fb-abba-3a8d95a68b15", "tag": "d0cfa42e-1837-495b-ab4d-b068c0dea18c"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:17:29.936748 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:29.937314 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:29.937910 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:29.950661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] Creating event network-changed:d0cfa42e-1837-495b-ab4d-b068c0dea18c for instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 on hv-cinder-86020 Nov 02 04:17:29.955693 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-1cd43860-d299-43ba-9d33-91ac757170df req-d6d355d1-49a0-4736-a2b6-a0d9be143bb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034986 Nov 02 04:17:29.956309 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1409/2820] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:17:30.821617 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:30.822230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:30.828518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:30.828999 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:30.829431 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:30.830114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:30.830640 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:30.831059 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:31.047903 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:31.055473 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-6b11e43a-16ad-4894-8c72-9886c14b3297 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.237833 Nov 02 04:17:31.056060 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1412/2821] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:30 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:32.079332 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:32.080062 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:32.086723 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:32.087197 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:32.087633 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:32.088343 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:32.088795 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:32.089218 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:32.216453 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:32.224073 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-15d437d3-d46e-4381-a98c-c5e538f21745 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.149372 Nov 02 04:17:32.224634 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1410/2822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:32 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:33.246475 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:33.247365 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:33.253756 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:33.254234 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:33.254659 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:33.255845 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:33.256323 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:33.256742 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:33.386023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:33.393698 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-59148e10-b3e6-4a83-b1f9-31d91cad1e05 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.151056 Nov 02 04:17:33.394258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1413/2823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:33 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:34.465174 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:34.465786 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:34.471609 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:34.472122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:34.472559 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:34.473240 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:34.473695 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:34.474706 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:34.604452 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:34.612104 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9d1e9c88-5ab6-46f4-8eb0-ef8f8ead38a3 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.198813 Nov 02 04:17:34.612659 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1411/2824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:34 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:35.635093 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:35.635706 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:35.642087 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:35.642566 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:35.643001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:35.643682 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:35.644185 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:35.644602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:35.774612 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:35.782264 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-92a4fd97-a1f7-40c7-a102-2a8e8bf6ad73 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.150969 Nov 02 04:17:35.782758 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1414/2825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:35 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:36.803797 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:36.804361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:36.810767 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:36.811237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:36.811668 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:36.812365 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:36.812808 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:36.813223 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:36.939939 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:36.948220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-f5057e9c-44b5-415b-8c9f-f3f1eb1a2398 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.148299 Nov 02 04:17:36.948781 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1412/2826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:36 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:37.970938 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:37.971553 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:37.973935 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell0:SELECT=2 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:37.979818 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:37.980339 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:37.980781 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:37.982525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:37.982983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:37.983413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:38.116273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:38.124279 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-5ace84d2-ce42-498f-81e5-63716de83096 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.157177 Nov 02 04:17:38.124871 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1415/2827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:37 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:39.147361 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:39.147994 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:39.149943 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=2 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:39.150616 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell0:SELECT=6 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:17:39.157072 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:39.157544 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:39.157974 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:39.158647 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:39.159092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:39.159524 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:39.288891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:39.296582 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-c474bd8d-978a-4436-9393-4e16f3033449 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.153021 Nov 02 04:17:39.297144 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1413/2828] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:39 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:40.325487 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:40.326134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:40.332597 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:40.333083 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:40.333523 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:40.334214 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:40.335184 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:40.335615 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:40.462134 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:40.469827 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-be058562-2585-4f5e-b7f4-5be23d87818c tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.153135 Nov 02 04:17:40.470402 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1416/2829] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:40 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:41.491508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f85259-f6cf-48fb-abba-3a8d95a68b15", "name": "network-vif-plugged", "status": "completed", "tag": "d0cfa42e-1837-495b-ab4d-b068c0dea18c"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:17:41.493922 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:41.494918 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:41.502113 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:41.502631 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:41.502770 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:41.503158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:41.503273 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:41.503589 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:41.503883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:41.504652 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:41.505118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:41.515164 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] Creating event network-vif-plugged:d0cfa42e-1837-495b-ab4d-b068c0dea18c for instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 on hv-cinder-86020 Nov 02 04:17:41.520138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-62687914-3ccd-4b54-a2c0-09f768337b9d req-b9151fc9-2be0-44ec-af95-dffaea77e5f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Nov 02 04:17:41.520726 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1414/2830] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:17:41.651074 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:41.658836 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-be496681-3ddd-4a56-97dd-31921525bda7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.169817 Nov 02 04:17:41.659486 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1417/2831] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:41 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:17:42.683969 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:42.684664 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:42.690707 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:42.691173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:42.691600 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:42.692298 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:42.692743 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:42.693160 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:42.825083 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:42.832686 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-0179c9b5-fabd-4f2d-a918-43f19e8a1fc7 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1266 microversion: 2.1 time: 0.153392 Nov 02 04:17:42.833237 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1415/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:42 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:43.855625 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:43.856227 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:43.862660 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:43.863118 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:43.863554 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:43.864258 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:43.864713 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:43.865135 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:43.994831 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:44.002697 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-66a408ad-f68e-4c26-b08d-aa2d656ac690 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1453 microversion: 2.1 time: 0.151050 Nov 02 04:17:44.003261 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1418/2833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:43 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:17:44.025496 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:17:44.026107 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:17:44.033203 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:44.033679 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:44.034116 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:44.034798 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:44.035248 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:44.035669 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:44.160685 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:17:44.168424 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-af850af9-7904-4c28-80f3-914066dffba5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1453 microversion: 2.1 time: 0.147305 Nov 02 04:17:44.168986 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1416/2834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:17:44 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 04:17:45.929555 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f85259-f6cf-48fb-abba-3a8d95a68b15", "tag": "d0cfa42e-1837-495b-ab4d-b068c0dea18c"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:17:45.939334 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:17:45.939803 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:17:45.940257 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:17:45.951772 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] Creating event network-changed:d0cfa42e-1837-495b-ab4d-b068c0dea18c for instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 on hv-cinder-86020 Nov 02 04:17:45.956806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-0809d0d9-8e34-496c-912c-ffe608eb9075 req-2cb3431a-ef05-4432-b5e3-f3b597051867 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 Nov 02 04:17:45.957390 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1419/2835] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:19:15.257962 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:19:15.258851 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG dbcounter [-] [125410] Writing DB stats nova_cell1:SELECT=48 {{(pid=125410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:19:15.259931 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:19:15.260208 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Wed Nov 2 04:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 (ip 10.222.0.26) !!! Nov 02 04:19:15.260504 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_api:SELECT=22 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:19:15.263342 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG dbcounter [-] [125411] Writing DB stats nova_cell1:SELECT=50 {{(pid=125411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 04:19:15.263515 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:19:15.264104 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 04:19:15.265305 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 04:19:15.265592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Wed Nov 2 04:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Nov 02 04:19:15.266229 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:15.266725 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:15.272199 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f85259-f6cf-48fb-abba-3a8d95a68b15", "tag": "d0cfa42e-1837-495b-ab4d-b068c0dea18c"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:19:15.275350 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:15.276115 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:15.277423 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:15.278138 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:15.278594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:15.279025 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:15.286592 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:15.287383 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:15.287883 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:15.302023 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] Creating event network-changed:d0cfa42e-1837-495b-ab4d-b068c0dea18c for instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 on hv-cinder-86020 Nov 02 04:19:15.306874 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:19:15.307316 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-99ed60da-77e8-4a4c-bec9-821d796d50b2 req-dcc0395f-9fb7-4015-b8da-cf6c82f58549 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048670 Nov 02 04:19:15.308052 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1420/2836] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:19:15.389955 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-7eba10bb-0c23-45d7-a511-6399a8b0fa56 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 204 len: 0 microversion: 2.1 time: 0.133740 Nov 02 04:19:15.390891 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1417/2837] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:19:15 2022] DELETE /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:19:15.399939 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:15.401125 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:15.409482 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:15.409983 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:15.410430 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:15.411299 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:15.411766 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:15.412224 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:15.548254 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:15.556025 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-8a6576e7-5eaa-4250-baea-6401d69e5d26 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1577 microversion: 2.1 time: 0.160699 Nov 02 04:19:15.556591 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1421/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:15 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:16.583222 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:16.583983 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:16.591066 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:16.591540 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:16.591997 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:16.592681 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:16.593136 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:16.593558 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:16.826843 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:16.834362 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-88c84f39-6729-4bfa-bd67-4a456d043ef4 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1577 microversion: 2.1 time: 0.255358 Nov 02 04:19:16.834922 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1418/2839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:16 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:17.858795 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:17.859419 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:17.865913 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:17.866408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:17.866848 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:17.867598 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:17.868130 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:17.868525 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:17.936614 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f85259-f6cf-48fb-abba-3a8d95a68b15", "name": "network-vif-deleted", "tag": "d0cfa42e-1837-495b-ab4d-b068c0dea18c"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:19:17.940167 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:17.947430 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:17.948158 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:17.948594 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:17.950154 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-7808ae6e-a8c6-4d65-bfbe-3d05f2ec507b tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 200 len: 1391 microversion: 2.1 time: 0.095924 Nov 02 04:19:17.960037 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1422/2840] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:17 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:17.960873 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] Creating event network-vif-deleted:d0cfa42e-1837-495b-ab4d-b068c0dea18c for instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 on hv-cinder-86020 Nov 02 04:19:17.965646 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-f52fda64-e014-4a9c-a4bc-52a56f8d6f85 req-63c7261f-1302-4afe-b475-b151b88ec737 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095549 Nov 02 04:19:17.966226 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1419/2841] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 04:19:18.973891 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:18.974509 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 43f85259-f6cf-48fb-abba-3a8d95a68b15] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:18.981325 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:18.981806 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:18.982242 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:18.982927 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:18.983386 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:18.983807 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:18.999884 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] HTTP exception thrown: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Request method failure captured: Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 HTTP/1.1 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe4sRjoLNIgRQfPQjTsN9elCjbXFp4uOIE2tPbFBCpSBcq6aaqcJPKHai9E-p3i8zh_SMVdnM7R7-LHm-L7Om0EQlb5bxa2W6RUnqwmTYWwawumMQFJJc3NqIPccu2q_Op1Zw1GOET74n8h7MmE48gXSl4kzhq3_Aq2JCH4HqGApCtc Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:19:19.001530 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}] Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 390f0d31f2ee42d9aba3922cce6e78ee Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. Nov 02 04:19:19.002889 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '43f85259-f6cf-48fb-abba-3a8d95a68b15'} Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:19:19.003633 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. Nov 02 04:19:19.005381 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:19.006822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Returning 404 to user: Instance 43f85259-f6cf-48fb-abba-3a8d95a68b15 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:19:19.006822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-1fae310c-888a-438f-9e44-2909a62ac980 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15" status: 404 len: 111 microversion: 2.1 time: 0.033190 Nov 02 04:19:19.006822 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1423/2842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:18 2022] GET /compute/v2.1/servers/43f85259-f6cf-48fb-abba-3a8d95a68b15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:19:22.043366 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:22.043964 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:22.045641 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f29aac9-b6d4-428c-a2d5-f3b20482036a", "tag": "a5c55c21-fbbc-47c2-a8dd-79c23a5352bb"}]} {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:19:22.050856 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:22.051333 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:22.051768 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:22.052484 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:22.053108 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:22.053529 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:22.057413 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:22.058001 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:22.058561 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:22.070322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.compute.server_external_events [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] Creating event network-changed:a5c55c21-fbbc-47c2-a8dd-79c23a5352bb for instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a on hv-cinder-86020 Nov 02 04:19:22.076528 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [req-287facc5-2ff3-4010-95c3-fa6f6498438a req-2277edf4-f8a8-4936-a1fa-97c68aaa52de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Nov 02 04:19:22.077328 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1424/2843] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:19:22.081220 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Going to try to terminate instance {{(pid=125410) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 04:19:22.162564 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-be53f750-b055-4464-8005-e9bdae6e1a7f tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 204 len: 0 microversion: 2.1 time: 0.122589 Nov 02 04:19:22.163077 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1420/2844] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:19:22 2022] DELETE /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 04:19:22.177377 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:22.178636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:22.185629 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:22.186108 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:22.186546 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:22.187236 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:22.187810 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:22.188129 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:22.322720 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:22.331049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-fb36e58c-f389-43b3-b366-3ac7d8b5d279 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1578 microversion: 2.1 time: 0.161460 Nov 02 04:19:22.331607 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1425/2845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:22 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:23.354826 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:23.355967 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:23.362419 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:23.362897 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:23.363327 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:23.364059 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:23.364508 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:23.364949 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:23.499253 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.policy [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125410) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:23.507165 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-df6668d9-a9f7-4873-8984-b3ac6d24c2a8 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1578 microversion: 2.1 time: 0.156606 Nov 02 04:19:23.507728 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1421/2846] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:23 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:24.530741 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:24.531322 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:24.531678 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f29aac9-b6d4-428c-a2d5-f3b20482036a", "name": "network-vif-deleted", "tag": "a5c55c21-fbbc-47c2-a8dd-79c23a5352bb"}]} {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 04:19:24.538797 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:24.539427 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:24.540096 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:24.540798 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:24.541552 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:24.541985 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:24.542336 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:24.542457 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:24.542902 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:24.554783 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.compute.server_external_events [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] Creating event network-vif-deleted:a5c55c21-fbbc-47c2-a8dd-79c23a5352bb for instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a on hv-cinder-86020 Nov 02 04:19:24.559933 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [req-fda32cea-95d1-4c2d-92a4-11a10ff748db req-d8298388-0500-42a1-93c2-a62bfb2c7890 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Nov 02 04:19:24.560567 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1422/2847] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Nov 2 04:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 04:19:24.614082 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.policy [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390f0d31f2ee42d9aba3922cce6e78ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143ef6c3d11b42c595e2fda02cc5a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125411) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 04:19:24.622292 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-edb8f904-b8e0-421c-8e05-07ce89fd09fe tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 200 len: 1392 microversion: 2.1 time: 0.095936 Nov 02 04:19:24.622857 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1426/2848] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:24 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 1392 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 04:19:25.647661 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:25.648355 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 6f29aac9-b6d4-428c-a2d5-f3b20482036a] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:25.655092 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:25.655575 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:25.656046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:25.656735 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:25.657196 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:25.657619 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:25.670476 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] HTTP exception thrown: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Request method failure captured: Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a HTTP/1.1 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe4sRjoLNIgRQfPQjTsN9elCjbXFp4uOIE2tPbFBCpSBcq6aaqcJPKHai9E-p3i8zh_SMVdnM7R7-LHm-L7Om0EQlb5bxa2W6RUnqwmTYWwawumMQFJJc3NqIPccu2q_Op1Zw1GOET74n8h7MmE48gXSl4kzhq3_Aq2JCH4HqGApCtc Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:19:25.672099 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}] Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 390f0d31f2ee42d9aba3922cce6e78ee Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. Nov 02 04:19:25.673565 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '6f29aac9-b6d4-428c-a2d5-f3b20482036a'} Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:19:25.674425 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. Nov 02 04:19:25.675812 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:25.677122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Returning 404 to user: Instance 6f29aac9-b6d4-428c-a2d5-f3b20482036a could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:19:25.677122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-e0fff0e1-808c-4717-bd67-7e17a707cdc5 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a" status: 404 len: 111 microversion: 2.1 time: 0.030782 Nov 02 04:19:25.677122 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1423/2849] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:25 2022] GET /compute/v2.1/servers/6f29aac9-b6d4-428c-a2d5-f3b20482036a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:19:26.106602 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:26.107230 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.compute.api [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125411) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:26.113934 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:26.114408 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:26.114839 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:26.115517 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:26.115985 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:26.116412 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG oslo_concurrency.lockutils [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:26.129480 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.wsgi [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] HTTP exception thrown: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Request method failure captured: Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: request: DELETE /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 HTTP/1.1 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept: application/json Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Accept-Encoding: identity Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Connection: close Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Length: 0 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Content-Type: application/json Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Host: 10.222.0.26 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: Openstack-System-Scope: None Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: User-Agent: python-urllib3/1.26.12 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Auth-Token: gAAAAABjYe4sRjoLNIgRQfPQjTsN9elCjbXFp4uOIE2tPbFBCpSBcq6aaqcJPKHai9E-p3i8zh_SMVdnM7R7-LHm-L7Om0EQlb5bxa2W6RUnqwmTYWwawumMQFJJc3NqIPccu2q_Op1Zw1GOET74n8h7MmE48gXSl4kzhq3_Aq2JCH4HqGApCtc Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Id: None Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Domain-Name: None Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Identity-Status: Confirmed Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Is-Admin-Project: True Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Id: default Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Domain-Name: Default Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Project-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Role: member,reader Nov 02 04:19:26.131114 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Roles: member,reader Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}] Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Id: default Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Domain-Name: Default Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Id: 390f0d31f2ee42d9aba3922cce6e78ee Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: X-User-Name: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: method: > Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: exception: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.132636 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: action_args: {'id': '1cd6662c-4740-4d9d-9d77-76973e7ffac4'} Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:19:26.133518 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.134866 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.136374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Returning 404 to user: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. {{(pid=125411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:19:26.136374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-cfef44e6-85ee-466c-a165-0f85f39c41bf tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 404 len: 111 microversion: 2.1 time: 0.030716 Nov 02 04:19:26.136374 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1427/2850] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Nov 2 04:19:26 2022] DELETE /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 04:19:26.141013 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '>' {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:26.141629 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.compute.api [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] [instance: 1cd6662c-4740-4d9d-9d77-76973e7ffac4] Fetching instance by UUID {{(pid=125410) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 04:19:26.147542 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:26.148051 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:26.148502 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:26.149173 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Acquiring lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 04:19:26.149623 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 04:19:26.150046 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG oslo_concurrency.lockutils [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Lock "f9c6a98e-99ee-4bad-903f-8a98c80704c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 04:19:26.163454 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.wsgi [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] HTTP exception thrown: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Request method failure captured: Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: request: GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 HTTP/1.1 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept: application/json Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Accept-Encoding: identity Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Connection: close Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Length: 0 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Content-Type: application/json Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Host: 10.222.0.26 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: Openstack-System-Scope: None Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: User-Agent: python-urllib3/1.26.12 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Auth-Token: gAAAAABjYe4sRjoLNIgRQfPQjTsN9elCjbXFp4uOIE2tPbFBCpSBcq6aaqcJPKHai9E-p3i8zh_SMVdnM7R7-LHm-L7Om0EQlb5bxa2W6RUnqwmTYWwawumMQFJJc3NqIPccu2q_Op1Zw1GOET74n8h7MmE48gXSl4kzhq3_Aq2JCH4HqGApCtc Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Id: None Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Domain-Name: None Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Identity-Status: Confirmed Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Is-Admin-Project: True Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Id: default Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Domain-Name: Default Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Project-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Role: member,reader Nov 02 04:19:26.164978 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Roles: member,reader Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143ef6c3d11b42c595e2fda02cc5a1b8"}]}] Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Id: 143ef6c3d11b42c595e2fda02cc5a1b8 Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539364834 Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Id: default Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Domain-Name: Default Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Id: 390f0d31f2ee42d9aba3922cce6e78ee Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: X-User-Name: tempest-TestVolumeBootPattern-1539364834-project Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: method: > Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: exception: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.166450 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: action_args: {'id': '1cd6662c-4740-4d9d-9d77-76973e7ffac4'} Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: {{(pid=125410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 04:19:26.167356 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. Nov 02 04:19:26.169415 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: ERROR nova.api.openstack.wsgi Nov 02 04:19:26.170705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: DEBUG nova.api.openstack.wsgi [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Returning 404 to user: Instance 1cd6662c-4740-4d9d-9d77-76973e7ffac4 could not be found. {{(pid=125410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 04:19:26.170705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: INFO nova.api.openstack.requestlog [None req-9532998a-facc-4db7-ad0d-96dc6213ecab tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4" status: 404 len: 111 microversion: 2.1 time: 0.029189 Nov 02 04:19:26.170705 dv-cinder-860209-6-iscsi devstack@n-api.service[125410]: [pid: 125410|app: 0|req: 1424/2851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Nov 2 04:19:26 2022] GET /compute/v2.1/servers/1cd6662c-4740-4d9d-9d77-76973e7ffac4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 04:19:27.459049 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: DEBUG nova.api.openstack.wsgi [None req-67b28114-2df0-4e47-9d1c-47e05ff54fc1 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] Calling method '.version_select at 0x7f5c924e05e0>' {{(pid=125411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 04:19:27.486384 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: INFO nova.api.openstack.requestlog [None req-67b28114-2df0-4e47-9d1c-47e05ff54fc1 tempest-TestVolumeBootPattern-1539364834 tempest-TestVolumeBootPattern-1539364834-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-122927319" status: 202 len: 0 microversion: 2.1 time: 0.031061 Nov 02 04:19:27.486994 dv-cinder-860209-6-iscsi devstack@n-api.service[125411]: [pid: 125411|app: 0|req: 1428/2852] 10.222.0.26 () {58 vars in 1260 bytes} [Wed Nov 2 04:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-122927319 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)